{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"61cb4ecc-e0b4-5674-836b-1da615588632","task_key":"default--validation--14828","task_revision_id":"1","upstream_id":"14828","short_description":"HellaSwag validation 14828","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to get your child to use a baby walker [title] Determine if your baby is ready for a walker. [step] There are differing opinions on exactly when a baby is ready to use a baby walker. There is no set age, since all babies develop at their own rate.\",\"endings\":\"['Questions about how to start a child walker program should be considered for parents. [substeps] The early childhood walkers are older versions of the toddler walker.', 'However, there are certain signs that indicate when the baby is ready to use a baby walker : [substeps] In order to use a baby walker, the baby should be able to sit up on their own and be able to crawl. Sitting up is necessary because the baby needs to sit up in the walker.', 'Some children are ready with a baby walker when they are one year old and ready to have another baby. [title] Exercise caution when getting a baby walker.', 'In general, babies between the ages of 4 and 6 months are ready for a walker. [title] Choose a stroller that has four handles.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}