{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"65a20a4a-f96d-5f72-91f5-f6d0b0f4b2f1","task_key":"default--validation--6359","task_revision_id":"1","upstream_id":"6359","short_description":"HellaSwag validation 6359","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to know what to expect on a newborn's skin [title] Note your newborn's skin tone. [step] At birth, a newborn's skin may be reddish or pinkish. However, the baby's hands and feet may be bluish (acrocyanosis) because blood and oxygen are not yet circulating fully to the extremities.\",\"endings\":\"[\\\"As the newborn's circulatory system opens, this bluish color will subside. [substeps] If your newborn's skin is bluish all over (cyanosis), however, let your physician know right away.\\\", \\\"This means they will not produce much oxygen. During your newborn's first few months, keep in mind that the inside of their diaper should be pink in appearance, and the eyes blue.\\\", \\\"Therefore, it's important to measure the temperature and tone of your newborn's skin before attempting to formulate a plan to replicate the actual pregnancy. [substeps] You'll first need to check the mother's temperature.\\\", 'A newborn\\\\'s skin color is linked to their normal appearance, so the newborn\\\\'s hands and feet may appear lighter than normal at birth. [substeps] The \\\" white \\\" spot is located just behind the eyeball of the newborn.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}