{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0f8dd247-5f06-563a-91d6-21f58c51e3ff","task_key":"default--validation--16083","task_revision_id":"1","upstream_id":"16083","short_description":"HellaSwag validation 16083","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to spot a gifted toddler [title] Take note of their curiosity. [step] Your child may be gifted if they are intensely curious about the world around them. If they show curiosity through touch, smell or verbally, they may be gifted.\",\"endings\":\"[\\\"If they communicate with other children in a clear way, they may benefit from reading books or videos about plants, animals, cultures and people. If your child expresses curiosity by studying plants at home, it's possible that they're gifted.\\\", '[title] Go to their classroom and observe them. [step] Give them a tour of the space.', 'An gifted toddler can send the message to adults that their lives are exciting, something that can lead to increase interest in life. [substeps] A gifted toddler will have an obsession with valuing things and because of this childlike curiosity, they are prone to be very inquisitive about things.', 'For example, see if they ask a lot of questions about the world. Examples include the following questions : [substeps] \\\" why is the sky blue? \\\" \\\" where did i come from? \\\" \\\" why are there homeless people? \\\" [title] See if they have an exceptional memory.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}