{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"40b5b789-8df1-5bcd-8405-fb291b08f6ca","task_key":"default--validation--18981","task_revision_id":"1","upstream_id":"18981","short_description":"HellaSwag validation 18981","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to diagnose post traumatic stress disorder [title] Recognize the presence of a traumatic event. [step] Ptsd occurs after a traumatic event. A traumatic event is something that deeply impacts someone such as a brush with death, violence, or serious injury.\",\"endings\":\"['Note if a traumatic event makes you feel stress. Make a list of the events that have made you have ptsd.', 'Ptsd can be triggered by inconsistent or over the top events that do not directly relate to themselves, or by the inability to respond to stress or anxiety. [substeps] The person may experience flashbacks to the event as part of experiencing normal emotions.', 'The event can have actually happened or may have been threatened (such as being threatened by a gun or threatened with violence). [substeps] Some events may be experienced as more traumatic to some than to others.', \\\"The traumatic event could be a person's plane falling down, the defendant's car going into the ocean, or a friend's car crash. Ptsd occurs after traumatic events, like the loss of a loved one or the suicide of a loved one.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}