{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0aa911e9-7a1f-5e4b-897c-81d6dd1db698","task_key":"default--validation--49597","task_revision_id":"1","upstream_id":"49597","short_description":"HellaSwag validation 49597","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to do abdominal exercises in yoga [title] Do the lotus pose to start things off. [step] This is a simple pose that relaxes the mind and prepares it for a full and extensive workout. The pose helps strengthen and stimulate the muscles around your legs and knees, while focusing yourself for the workout ahead.\",\"endings\":\"['[substeps] This basic pose combines poses of the lotus and the backbend pose. Stand with your feet slightly wider than shoulder width.', '[substeps] Start out lying on your back on a yoga mat, with your knees bent and your feet together. Turn the bottom of your torso toward the ceiling and keep your feet firmly on the ground.', '[title] Begin with the four legs splayed before you. [step] Cross your right foot in front of your left.', 'Stay in lotus for as long as you wish, focusing on becoming aware of your breathing. The breathing rhythm you achieve in this opening position will set the tone for all positions ahead.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}