{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2e5fb69a-7a56-56a4-8ad5-002fa1bc5abd","task_key":"default--validation--45491","task_revision_id":"1","upstream_id":"45491","short_description":"HellaSwag validation 45491","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to talk with kids about political ads [title] Ask them what they know. [step] Sit down with your child and ask them about what they know about elections, politics, and politicians. Get a feel for what your child knows and how they understand the political ads.\",\"endings\":\"['You want your questions to be tailored to your child, which can make the interaction much more pleasant. [substeps] Ask them questions like, \\\" are there any political ads in town? \\\" \\\" what\\\\'s on election day? \\\" or \\\" what do you think we need to do to get elected? \\\" [title] Find out what the campaign is about.', '[substeps] Ask about political topics like democrat ideas, political groups, political goals, how politically competitive and potentially challenging/risky political ads are, and so forth. Avoid breaking the ice by saying something like, \\\" i noticed that our competition campaign for local university advertising starts soon after elections.', \\\"[substeps] Keep your questions short, broad, and simple. Don't worry about spelling the message, because you can bring the message closer to important feelings.\\\", \\\"This can help you gauge their understanding, their fears, and their questions. Knowing your child's understanding can help guide you to talk to them in an age-appropriate way that addresses their concerns.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}