{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"07412b0a-d061-5af8-a3db-50d26f140a54","task_key":"default--validation--40220","task_revision_id":"1","upstream_id":"40220","short_description":"HellaSwag validation 40220","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to raise respectful, confident teenagers [title] Help your children accomplish the most important job of adolescence : [step] Breaking away from you. Compliance is not your goal. Their developmental task is individuation, which means growing up into their own person.\",\"endings\":\"['They often find themselves smarter, more intelligent, and larger headed. If they reach adulthood, they begin finding value in the struggles they face, not in their ability to excel in school or do their homework.', 'Help them to learn that they can be the dominant, and who they can challenge when they misbehave. [substeps] When moving, provide them with a place to practice walking, running, climbing stairs, or watching tv.', 'It is normal, healthy and necessary for them to question your values and what you think. Expect them to disagree-and in fact, celebrate it.', 'Leave them to their own worst and tough to live up to. [substeps] Speak with others during extracurricular activities and make sure that they praise your efforts and hobbies.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}