{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"14a68f03-862f-5317-902c-d9d4b8dc6194","task_key":"default--validation--12611","task_revision_id":"1","upstream_id":"12611","short_description":"HellaSwag validation 12611","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to obtain a temporary restraining order [title] Document any physical abuse. [step] If possible, you should have evidence of any physical violence you have suffered. Although it might be difficult to think clearly after a violent episode, you should gather the following evidence, which could be helpful for your case : [substeps] Photographs of bruises or cuts on your face or body.\",\"endings\":\"['If there has been any physical abuse, then you should have taken the picture as well. You also might have suffered a verbal assault or hit someone with a hairbrush.', '[substeps] Evidence of physical or emotional abuse that would trigger the temporary restraining order. Old records from court where the abuse took place or when the person visited the facility.', 'Photographs can be helpful, even if you take them after a few days have passed. Photographs or other evidence of the damage the abuser caused your property.', 'Police uniforms and badges that show the painful physical trauma sustained. A copy of the police report that shows what happened.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}