{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8e1057ca-32c9-5fd6-a37d-f314e9321ca5","task_key":"default--validation--9197","task_revision_id":"1","upstream_id":"9197","short_description":"HellaSwag validation 9197","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to cope with panic attacks [title] Do some grounding exercises. [step] When in the middle of a panic attack, it's likely you will struggle to breathe naturally. The best way to work through a panic attack is to turn your attention to your breathing.\",\"endings\":\"['You can simply take a few deep breaths in and out without feeling any pain. To perform a grounding exercise : [substeps] Reach under your desk and grab a book with a cover.', 'Here are some things to start with : [substeps] Get on the floor. Spread your feet apart, so that you are almost fully upright on all fours.', 'Focusing on your breath and learning to deepen it will help you relax and work through the panic attack. Breath awareness can end a panic attack and decrease their frequency overall.', 'Do these exercises for several minutes at a time : [substeps] Breathe in slowly, hold your breath for five seconds, then exhale. Breathe out slowly through your nose four times.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}