{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2f469333-0ce4-5bc8-9011-8cf275f06559","task_key":"default--validation--43204","task_revision_id":"1","upstream_id":"43204","short_description":"HellaSwag validation 43204","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to raise no tv children [title] Explain your concerns. [step] The american academy of pediatrics recommends that children under two do not watch tv at all, and that all other children have no more than one or two hours of screen time per day. Explain to your children that you are trying to do what is best for them, and to encourage healthy habits.\",\"endings\":\"['[substeps] Explain to them that tv kids don\\\\'t \\\" about \\\" human beings or our lives because it is neither the time nor the place for that. Explain to them that watching is something that these children should do.', '[substeps] Explain to your children how you will encourage them to make dvd\\\\'s. You can say: \\\" we want your favorite movie, but it is not recommended for all children as these tv sets are too expensive.', '[substeps] You can set as many screens as you can. You can say, \\\" watching tv will lead us to think about childhood life \\\" or \\\" watching shows outside of tv will make us think of family life.', '[title] Avoid ever introducing a television into your home. [step] It can be much easier to raise children with a \\\" no tv \\\" policy if they have never experienced having a television at home.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}