{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ab5d4332-c583-5007-b868-c72273719a75","task_key":"default--validation--17962","task_revision_id":"1","upstream_id":"17962","short_description":"HellaSwag validation 17962","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to discipline a group of children [title] Have positive expectations. [step] Show the kids in your group that you believe in them. Interact with them in a warm, friendly way, and get to know each of them as an individual.\",\"endings\":\"['Be kind, collected, and considerate of the needs of the group. Respond positively to changes in their temperament, like adults who have dealt with difficult children so far.', \\\"Even if they don't have qualities you admire or believe in, make sure that their actions help them grow up and succeed. Some ideas are : [substeps] Positive reinforcement rewards rewards sets children straight and healthy in their behavior school and job plans [title] Be consistent.\\\", 'Children will find it easier to discipline and can begin to respect you. [substeps] Many parents find it exciting to have a role model model that helps children learn how to deal with difficult situations.', 'Look for the best in them, instead of waiting for a reason to discipline them. [substeps] If you are a teacher, make every child feel like a valued member of the group by greeting them by name when they enter the classroom.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}