{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f5ae3cd9-3c65-5714-a25f-277e3c57b17b","task_key":"default--validation--42211","task_revision_id":"1","upstream_id":"42211","short_description":"HellaSwag validation 42211","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to maintain a healthy liver [title] Limit alcohol consumption. [step] Alcohol can damage or destroy liver cells, eventually causing permanent scarring which impedes or even ceases liver function. [substeps] If you're a woman, you should restrict your consumption to one alcoholic drink per day.\",\"endings\":\"['This means at least as much as two drinks per day. Some women should limit alcohol entirely when they are pregnant, on steroids, and were recently diagnosed with liver disease (among others).', 'Men may have two alcoholic drinks per day. Even if you only drink rarely, be mindful of over-consuming even on isolated occasions.', \\\"You can limit the amount of alcohol you drink based on age, sex, and other factors. For example, if you're in your late twenties to 30, you should limit your alcoholic intake to one liquor per day, and one non-alcoholic beverage per day.\\\", \\\"Any higher than that and your liver will quickly have to work harder to process metabolizers. Limit or stop drinking large quantities of alcohol, and seek medical treatment if you're drunk excessively.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}