{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d2d54891-bc4a-509a-ab12-a68f993fc17a","task_key":"default--validation--37708","task_revision_id":"1","upstream_id":"37708","short_description":"HellaSwag validation 37708","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to delay your baby's first bath [title] Find out the hospital protocol regarding bathing newborns. [step] In order to delay your newborn's first bath you should find out what the bathing protocol is for your hospital. Ask your obstetrician or midwife when babies are typically bathed following delivery, and then you can decide if you want to make a special request.\",\"endings\":\"['Some hospitals will bathe infants shortly after birth, while others will wait longer. [substeps] For example, at toronto east general hospital, a healthy baby who has a stabilized temperature will likely be bathed around 8 hours after birth.', \\\"[title] Use soap and water when washing your newborn. [step] Before you go into the bathroom for the first time, wash your newborn's body thoroughly, using the soap and water sections that come with your baby's bath kit.\\\", '[title] Get a robe or long sleeved dress. [step] Nursing a newborn can be extremely exposed to some temperature changes, especially in a sealed tub.', \\\"[substeps] It is important to understand that while newborn babies can be bathed outside of their mothers' bodies, they may never be bathed in their own bodies. For this reason, a newborn's first bath can seem strange.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}