{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"84a7bc4b-8818-5357-91f1-fc33568f53bc","task_key":"default--validation--31736","task_revision_id":"1","upstream_id":"31736","short_description":"HellaSwag validation 31736","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to baker act someone [title] Educate yourself about the baker act. [step] The baker act, also known as the florida mental health act (florida statute chapter 394, part i) is a law that was passed to ensure and regulate emergency mental health treatment services for those suffering from a mental illness. This law is meant to protect all people with serious mental illnesses in the state of florida.\",\"endings\":\"['[substeps] To become a baker, you must have completed a federal or equivalent training program. There are a number of courses available for the united states that will help you get into baker school.', '[substeps] The baker act provides procedures to guide both voluntary admissions and involuntary examinations of people suffering from a mental illness. The act also provides procedures for the involuntary inpatient placement (civil commitment) for someone suffering a mental health crisis.', 'One of the biggest reasons you would be in danger is if your family has suffered from mental illness. Having health care providers from the civil rights commission will help make your situation better.', 'It can also help if you are suffering from a negative mental illness in order to manage mental health. [substeps] To read about this writer, see take examiners under the new york real world, which rules provide the baker act.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}