{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1fef3b34-be58-5524-af93-3f13fa2ef1a7","task_key":"default--validation--40905","task_revision_id":"1","upstream_id":"40905","short_description":"HellaSwag validation 40905","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to build your baby's motor skills [title] Stroke the back of your child's hands. [step] You could stroke your child's hands with your own hand, or with an object you want them to become familiar with and grasp. For instance, if you want to encourage motor skills that could help your child grip a rattle, you might stroke the back of their hands gently with a rattle.\",\"endings\":\"['If your child becomes proficient at counting, you could have them count down while you stroke them. [substeps] Did you teach your child how to focus on numbers? Consider lesson ideas like \\\" 4 , 4 , 5-0.', \\\"When they open their fingers, place it in their palm. [substeps] Your baby might be able to grasp the rattle already, but they probably won't be able to hold it for long.\\\", \\\"[substeps] Generally, babies are thrilled by the feeling of their hands touching the shiny surface. They'll be able to grasp any object quickly without fear of injury.\\\", 'You may also pretend to grapple with inanimate objects by keeping the hands separated. During the stroke, you can make your child grip the objects firmly in order to become familiar with their altered positions.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}