{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bde7c0ad-1e5e-5f51-a6df-f88e2de9c7c1","task_key":"default--validation--2195","task_revision_id":"1","upstream_id":"2195","short_description":"HellaSwag validation 2195","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to get kids to clean [title] Start when they're young. [step] All good habits take time to develop, and helping children learn to participate in household tasks is no exception. The earlier you start teaching them basic cleaning skills, the better it will be for them.\",\"endings\":\"[\\\"Start slowing the' mopping' down the initial couple days after your teen begins to clean. [substeps] Don't leave your teen to do whatever they like on their own.\\\", \\\"This teaches them that they can stop by your house for every meal, and can only do that once they're capable of doing it on their own. At the same time, it can save you from taking on the responsibility of grooming your child and looking after him or her.\\\", \\\"[substeps] If your child is toilet-trained, they're old enough to learn to put away their things and to keep their toys straight. They're not ready to do the dishes yet, but they're ready to learn to put their own toys away.\\\", \\\"You can begin as young as around age nine, but every child's first month should improve as they can shift focus to cleanliness. [substeps] Toddlers are more likely to learn manual tasks, like the dishes from the sink and cleaning utensils.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}