{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"263f6ab3-bc84-5518-9cc0-d0b84cbe4a42","task_key":"default--validation--31553","task_revision_id":"1","upstream_id":"31553","short_description":"HellaSwag validation 31553","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to teach your child stroller safety [title] Understand the importance of teaching your child stroller safety. [step] Young babies are safe in strollers because they don't really move and are just strapped in for the ride. Things become difficult for toddlers around 18 months to 2 ½ years because they want to escape or walk by themselves.\",\"endings\":\"['A lot of times, your child will want to outmaneuver you by trying to fall from the stroller and getting caught. [substeps] It is important for young babies to learn to safely climb on and off the handles by their own hands, which are essentially autonomous beings.', \\\"Stroller safety protects them both physically and mentally. If you don't train your child stroller safety then they will get frustrated, anxious, and run away.\\\", 'Stroller safety can be even more difficult when children are young. [substeps] Lots of age groups believe that healthy infants have safety mechanisms that prevent accidents and theft.', '[substeps] This can be especially dangerous in crowded places, where it is easy to lose a small child. If your child runs away or tries to escape, try to look at things from his perspective.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}