{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"be5635d2-5aa5-5ba9-911d-58d0a48ffda9","task_key":"default--validation--41590","task_revision_id":"1","upstream_id":"41590","short_description":"HellaSwag validation 41590","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to teach a toddler to walk [title] Check your toddler's timeline. [step] Understanding the general timeline of expectations for your child's development will help you understand whether they are on track and ready to begin walking. All children are different, but it's good to have a rough guideline of when most children make strides toward walking.\",\"endings\":\"['[substeps] As toddlers grow, they will begin to have longer strides, usually around four to six weeks of age. Children can take every step that they need to.', '[substeps] Most toddlers begin walking between 12 and 15 months. Babies will have a step reflex between birth and 2 months.', 'This is particularly important for toddlers ages six-eight. Four or five? Age 1/6? 3/4? [substeps] Toddlers start walking as soon as it gets dark.', 'Many toddlers start walking before age five, while others begin it every 16 or so. [substeps] Toddlers growing up after puberty typically start walking a day before their due date.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}