{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d362f45d-e4e3-58ef-810a-8e9ff35fb33f","task_key":"default--validation--2576","task_revision_id":"1","upstream_id":"2576","short_description":"HellaSwag validation 2576","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to explain cremation to a child [title] Consider the child's age and developmental stage. [step] A child's age and developmental stage affects their understanding of death. Preschool age children might think death can be reversed.\",\"endings\":\"['Children ages 5-9 realize death is final, but think they can escape it. By age 10 children begin understanding death as an irreversible part of life that will eventually happen to them.', 'However, people of all ages are typically ready to talk about the situation. [substeps] Sometimes children are 12 year olds who want to talk about their wishes with their parents.', 'They might think an accident is the result of a failure to receive their share. That is why researching the various hypotheses available also helps children think about death.', \\\"However, the child might not be fully aware of the importance of the deceased child's death. Young children might need to understand this by learning more about the deceased child.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}