{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"28e783d6-161b-5a7c-8544-0e2455a4b890","task_key":"default--validation--29801","task_revision_id":"1","upstream_id":"29801","short_description":"HellaSwag validation 29801","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to distinguish sinusitis from similar conditions [title] Determine how long you are sick. [step] One way to tell the difference between sinusitis and another condition, such as a cold, is to look at how long they last. A sinus infection will cause symptoms for 10 days or longer and may get worse rather than improving over time.\",\"endings\":\"[\\\"You might have sinusitis for a number of reasons, including the following : [substeps] You have a viral infection, known as sinusitis or a bacterial infection. That's why you aren't able to urinate, talk, or drink in the first place.\\\", '[substeps] Women who have been sick for over 12 months have more sinusitis than women who have been pregnant or with other health conditions. [title] Note : [step] In some cases a female gets sinusitis as an internal infection.', '[substeps] Keep the severity of your symptoms in mind when deciding what kinds of treatment to seek. If you work long hours, for example, you might feel physically unwell when you initially take a cold.', '[substeps] A common cold will only last for 4-7 days, with symptoms typically getting briefly worse before gradually improving. The common cold can progress to sinusitis, so what begins as a cold may gradually become a sinus infection.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}