{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"14977021-de7d-519d-bb18-6d290ac8d3f4","task_key":"default--validation--14447","task_revision_id":"1","upstream_id":"14447","short_description":"HellaSwag validation 14447","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to practice nudity in your family [title] Explore family nudity without feeling it's abnormal. [step] Young children have not yet acquired a sophisticated understanding of modesty, and really don't care who sees them naked. [substeps] This is the time when the parent can teach children not to be self-conscious of their bodies or of their nakedness.\",\"endings\":\"['Just as on any occasion, it is wise to familiarize the children and adults with underwear and articles of clothing. This will help to limit this potential embarrassment and for them to explore their bodies openly without worrying about embarrassment.', 'It can also teach children that they do not have to bring one piece of clothing to a laundry trick. For instance, instead of wearing a flat, classic scoop-neck shirt and underneath a tank top, wear it with two shirts and a bra.', 'This, in turn, will help children associate nakedness to routine activity instead of exclusively sexual activity. As a result, the more prurient forms of nakedness lose their \\\" forbidden fruit \\\" appeal.', '[title] Teach children not to wear diapers. [step] Perhaps the greatest precaution for parental nudity in children at a young age is to not allow their child to wear diapers.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}