{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ef0eb9bd-a34a-53e5-93a4-28b56d4c7f94","task_key":"default--validation--37993","task_revision_id":"1","upstream_id":"37993","short_description":"HellaSwag validation 37993","config":"default","split":"validation","body":"{\"activity_label\":\"Home and Garden\",\"ctx\":\"[header] How to treat dissociative fugue [title] Rule out medical causes. [step] To diagnose dissociative fugue, your doctor must first rule out any medical causes. When examining you, a medical doctor may run a series of tests to rule out medical causes for the fugue.\",\"endings\":\"['[substeps] Your doctor may also want to interact with you to test for treated dissociative fugue, such as conditions that contribute to joint or muscle inflammation. A doctor may also refer you to someone who can diagnose your dissociative fugue.', 'A blood test may be asked, though, as would a radiogram to peer at brain tissue. These tests are not very conclusive, but they can put your doctor on the spot.', 'Some medical diagnoses, such as head injuries and brain diseases, can include memory problems or identity problems. [substeps] A physician may run blood tests, x-rays, other other diagnostic tests to rule out medical causes.', 'One of these tests includes : [substeps] A visual exam of your face and/or head. A specific tone of voice and vocal pitch.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}