{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4c28888d-6f92-55a3-89b2-88290d936cff","task_key":"default--validation--15905","task_revision_id":"1","upstream_id":"15905","short_description":"HellaSwag validation 15905","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to keep a toddler busy in a stroller [title] Get your toddler excited for the stroller. [step] Start by asking your toddler if they'd like to go outside in the stroller for a little while. Tell them it will be an exciting adventure and that they can play in the stroller.\",\"endings\":\"[\\\"If it's possible, provide a map of the surroundings to help, but be sure to also talk about when it will stop and how long it should stop. However, remember to always handle stroller matters in a way that isn't painful or disturbing to your toddler.\\\", '[substeps] Any time they are getting into the stroller to ride it, push them out and let them fall on the floor or perch on its back while giving them tips. When they want to explore, make sure to encourage them.', '[substeps] Try encouraging your toddler to get in the stroller later and saying \\\" you have a choice if you want. \\\" you can reinforce the idea that getting into a stroller can be exciting too.', 'Emphasize that the stroller will be a place where they play, sleep, or simply watch the world outside. This can help your toddler get excited about going into the stroller and make the stroller ride easier for you.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}