{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"de83a9ff-3e4a-5127-8eee-07f75ab690c7","task_key":"default--validation--35789","task_revision_id":"1","upstream_id":"35789","short_description":"HellaSwag validation 35789","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to stimulate gross motor skills in infants [title] Get your baby moving. [step] From being unable to lift up her head to being able to sit unsupported, your infant's body undergoes tremendous changes during the first six months. This is an exciting time, and you should encourage your baby to move around as much as possible.\",\"endings\":\"['[substeps] Give her a lot of opportunities to move. Engage her in fun games that will prod her to use her neck, chest, arms, and legs.', \\\"Focus on this while your baby is being born: keep moving as much as possible. Speak with your doctor or contact the pediatrician if you are worried about your baby's motor ability.\\\", '[substeps] Place your baby on a firm surface in a spacious living room. Stop playing games immediately and let her explore.', 'Interacting with your baby will make basic tasks, like organizing beds and toys, a lot easier. [substeps] Consider making sure your baby is able to lift up her head.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}