{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"65f93e6f-22b3-5e2b-8d44-0440bb7f5fad","task_key":"default--validation--44356","task_revision_id":"1","upstream_id":"44356","short_description":"HellaSwag validation 44356","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to teach children prediction skills [title] Emphasize patterns. [step] Pattern recognition is essential to prediction skills. Children in preschool are often developing their ability to recognize patterns.\",\"endings\":\"['You can help them by pointing out patterns in your everyday life. [substeps] You might use cut-out shapes to teach them patterns.', 'Tell children you will teach them patterns to make predictions instead of giving them predictions that just happen to them. [substeps] For example, you could instruct them to imagine there are four pipes running through a clock.', 'However, with older children, it is most important to emphasize patterns. Instead of simply saying, \\\" the weather is going to rain, \\\" teach your child patterns.', 'Even adults with dyslexia will often have patterns in what they see and hear. Even if children develop a pattern, they can still become effective in prediction.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}