{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"039e85e3-f3ea-530a-9380-78233a02ed26","task_key":"default--validation--28147","task_revision_id":"1","upstream_id":"28147","short_description":"HellaSwag validation 28147","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to cope with your father's death (for young people ) [title] Seek answers from adults. [step] Your dad's death may have left you with lots of confusion or unanswered questions. Though your mom or other relatives might be trying to protect you, it's understandable that you want to know the truth.\",\"endings\":\"[\\\"Try talking to other adults about why you think you are so frightened by your dad's death. [substeps] Make a list of all your uncle's friends, relatives, or workplace situations.\\\", \\\"If you're a teenager, however, parents might be worried you'll have to repeat the death. Ask yourself why their concern is so important to you in this way.\\\", 'Talk to your family and tell them what you\\\\'d like to know. [substeps] You might say, \\\" hey aunt judy, i know everyone is saying that dad got in a car wreck, but no one is saying how.', \\\"Though you may think your father knows everything, some adults might not know all that, so having answers as soon as you're old enough can help you deal with the inevitable awkwardness. [substeps] It may help to talk to a trusted adult about your father's death.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}