{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b4d43786-c4ee-535e-9837-912de4923a8d","task_key":"default--validation--7754","task_revision_id":"1","upstream_id":"7754","short_description":"HellaSwag validation 7754","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to teach your kid to tread water [title] Start early. [step] Kids should be taught to tread water before they are taught how to swim. Try to teach water treading as soon as your child is capable of following directions and copying the example you set for them.\",\"endings\":\"[\\\"[substeps] Younger kids won't need as much instruction as older children. You could introduce them to more natural water movements, like treading water with a downward stroke or swimming in the hands of a swimmer.\\\", 'They will learn how to use a rod while still choosing their plan. [substeps] Introduce your kids to different types of tricks, from water-safety techniques to jumping and running.', '[substeps] Big kids usually must first be picked up and carried by a broad-headed adult to learn how to tread water, and how to swim independently. Most parents should start instep swimming as early as possible, as young children are not built for this level of practice.', 'For most kids, this is usually around 2-5 years old. [substeps] Since younger kids are more prone to accidental drowning, teaching this skill helps to keep them safe.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}