{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b683bf6c-d351-5896-925d-435d25631ac2","task_key":"default--validation--4658--variant-d972b2e0b604","task_revision_id":"1","upstream_id":"4658--variant-d972b2e0b604","short_description":"HellaSwag validation 4658","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to prove assault [title] Describe the events that transpired. [step] The immediate events that constituted the assault may themselves provide clues to your assailant's intent. [substeps] Not only must you prove the assailant intended to harm you, but you also must prove he was capable of doing so.\",\"endings\":\"['Contrary to popular belief, a person does not have to physically hurt you or even touch you to be liable for assault. However, if you were not physically harmed, you must demonstrate that the person intended to harm you.', 'To prove assault was intentional on the part of the victim, you must have been transported to a location where you knew the assailant intended to rape or touch you. Both of these circumstances must be admitted in evidence.', 'For example, suppose the assault took place several hours prior to you leaving work at night on a weeknight. The assailant waited for you at the reception station instead of driving you home.', 'Victims often mistakenly explain the key elements of assault when your assailant did not intend to harm you physically or sexually. If the incident involved physical harm, you must prove the seriousness of the harm, as well as the extent of its consequences.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}