{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"26dc3492-ac0b-52c8-b239-63ebd0d0d8ff","task_key":"default--validation--14897","task_revision_id":"1","upstream_id":"14897","short_description":"HellaSwag validation 14897","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to choose an eating disorder treatment center [title] Decide if you need outpatient treatment. [step] Outpatient treatment centers is a treatment option where you visit the center to receive treatment, but return home that same day. Outpatient treatment centers provide flexible options for people, and are generally cheaper.\",\"endings\":\"['Talk to your physician before deciding to consider an outpatient treatment center, as they may require you to move to a different facility or move to a different hospital. [substeps] You will need to live in an area that is undergoing outpatient treatment, such as colorado, florida, alaska, or the west virginia territories.', '[substeps] Outpatient centers are good for those who have a job they want to continue doing, a job that fulfills them, or a job they are still able to complete. This option is helpful for early or less serious illnesses, as long as you are still able to carry out most of your daily activities.', '[title] Choose an eating disorder center that fits your needs. [step] There are a lot of workloads to choose from, which may include food only, immobility care options and interpersonal management.', '[substeps] To find a treatment center near you, go to the state or town in which you live. Once you find a town, check the listings to see if the professionals there have had the type of treatment they are seeking.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}