{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"36138970-938f-5e57-8475-d437bb5187e4","task_key":"default--validation--7933","task_revision_id":"1","upstream_id":"7933","short_description":"HellaSwag validation 7933","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to be a birth advocate [title] Study the biology of childbirth. [step] Learn the stages of labor, the importance of proper dilation, the type of physiological responses the mother will have to labor, the possible presentation positions of the baby, and what to expect during and immediately following delivery of the baby. [title] Learn about medical interventions and potential complications.\",\"endings\":\"['[step] If you are going to effectively communicate with medical staff and serve as an intelligent representative and advocate for the mother, it is your job to understand when and why medication or medical intervention may be necessary. [title] Read about childbirth in the chosen setting.', '[step] Contrary to popular belief, childbirth does not require medical intervention. Not only does it require a complete course of medical care (if needed), childbirth is also very physical and requires extensive training and dedication, health care, and practice.', '[step] Knowing about birth advocacy will prepare you for it. [substeps] The materials on birth advocacy are comprehensive or even in the form of books that cover each aspect of childbirth.', '[step] This refers to any abnormalities you may have with your baby, up to and during birth time. These include : [substeps] Possible birth defects: possible complications that may arise during pregnancy especially early in labor.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}