{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1707aa29-01f2-5c09-bb26-855ffdcee21d","task_key":"default--validation--21490","task_revision_id":"1","upstream_id":"21490","short_description":"HellaSwag validation 21490","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to cope with the death of a baby who died during labor and delivery [title] Say goodbye to the baby. [step] A stillbirth or death during delivery can be emotionally devastating. Many parents find it cathartic to hold the baby in order to create memories and find a sense of closure.\",\"endings\":\"['[substeps] Seeing the baby, holding him or her, and giving the child a name can be very helpful to parents whose child died during labor. Some parents like to take photographs to help them remember.', 'Think of this as the first time you know for sure that your baby is still alive, that his permanent home is there, and that your heart is still healing. [substeps] It may be daunting to decide what to say.', \\\"Simply telling a baby goodbye reminds the baby that they were born not so young and that the world is now around them again. When a baby realizes it's time to come to terms with death, the baby is ready to learn how to cope.\\\", 'Talk to your loved one about your intentions, and how you would like to grieve together. A baby that passed on in your womb will not have the same emotional experience as a dead baby.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}