{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"be2c37e9-c6df-5d2f-af85-8b3cb6a8d094","task_key":"default--validation--34602","task_revision_id":"1","upstream_id":"34602","short_description":"HellaSwag validation 34602","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to raise children successfullly [title] Help children learn about nature. [step] Teaching children to love and not fear nature is a vital part of teaching children that this a larger world than their bedroom and games station. It will give them the ability to feel a connection with something other than the house, school and local park.\",\"endings\":\"['[substeps] The elementary curriculum requires children to learn about nature from birth, and learn how to identify it and understand it. Even at a young age, children become proficient at discovering and appreciating nature and the way it feels to them.', 'It will also be a learning experience for young children. [substeps] Find new ways to enjoy outdoor sports.', 'Pack a couple sandwiches, take the kids into the woods and hike a deer trail through the woods. As you go : [substeps] Let the kids ask questions.', 'Many children like hiking, camping, wildlife photography, or nature watching, so they will enjoy the outdoors with you. [title] Show gratitude for your friends, family, and fellow caregivers.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}