{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"257909a7-f417-5d76-8c4e-c191224e0571","task_key":"default--validation--48659","task_revision_id":"1","upstream_id":"48659","short_description":"HellaSwag validation 48659","config":"default","split":"validation","body":"{\"activity_label\":\"Food and Entertaining\",\"ctx\":\"[header] How to help prevent child abuse before it happens [title] Provide access to parenting classes. [step] One way to stop child abuse before it begins is to help educate parents. Many people don't know how to raise children and base what they do on the way they were raised.\",\"endings\":\"['If you have any questions or concerns regarding child abuse, talk to a parent. [substeps] Pay attention to the classes offered in your community.', \\\"Talk to prospective parents at your nearby community center or school. Discuss with parents about what you hope to achieve in your child's life.\\\", 'This can lead to a limit in effective parenting skills, which may result in abusive behavior like yelling or hitting. [substeps] Communities can offer parenting classes for parents to learn the skills needed to be a successful parent.', \\\"While child neglect is difficult, research shows that parents can improve and will likely avoid baby neglect. If you know ways to help children, including teaching them household chores, instruct them about how to perform tasks they haven't used before, such as real house chores or baking services.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}