{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"198901bc-73f7-56b4-99e5-09f1b8a16aa8","task_key":"default--validation--25867","task_revision_id":"1","upstream_id":"25867","short_description":"HellaSwag validation 25867","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to do the crocodile pose in yoga [title] Assess your health and condition. [step] Even though the crocodile pose is, in most variations, a basic maneuver, it does involve moving and stretching that may exacerbate certain medical conditions. [substeps] While this pose can be quite helpful for back and neck stiffness or soreness, you should consult with a medical professional if you have a back or neck injury.\",\"endings\":\"['[title] Fully stretch your hamstrings. [step] You can stretch just about any part of your body to some degree with this pose.', 'The crocodile pose is not recommended if you are pregnant, as it places much of your body weight upon your abdomen while it is pressed to the ground. [title] Find a comfortable spot on the floor.', 'If you have a heavy load and have recently undergone surgery, you should also discuss your surgery options with your physical care professional. [title] Stand at a comfortable distance from the mat.', 'You can also incorporate the crocodile pose into more physical fitness exercises if you have a specific medical condition or problems that need improving, such as ptsd and joint pain. [title] Warm up your muscles by stretching them.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}