{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9646ed0c-a13a-55fd-afc0-045cdfd75dd8","task_key":"default--validation--8684","task_revision_id":"1","upstream_id":"8684","short_description":"HellaSwag validation 8684","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to deal with thick leg hair [title] Allow the hair to grow. [step] If you want to deal with hair growth on your legs, allowing your hair to grow actually makes surface hair removal treatments more effective. Because the hair strands will be longer, there will be more for a shaver or razor to latch onto.\",\"endings\":\"[\\\"[substeps] It's a good idea to shave at night rather than during the day. Shaving at night will leave your legs feeling smoother.\\\", '[substeps] As a general rule, the longer you let your hair grow, the thicker it will become. Trying to move the hair or playing with it too much will result in harsh stubble in your layered cut and eventual hair loss.', '[title] Wrap your hair in an elastic band and feed the ends of the elastic to the hair growth band. [step] The elastic band will hold the hair tight and allow you to avoid cutting the ends.', 'Some experts suggest that this is a good time to only allow hair to grow if you want to take a time-out or to work on different things (optional). [substeps] This is a good time to work on old towel towels or paper towels.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}