{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b1948071-d685-5590-8c9b-1f61cf967ec3","task_key":"default--validation--2041","task_revision_id":"1","upstream_id":"2041","short_description":"HellaSwag validation 2041","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to bond with your premature baby in the nicu [title] Learn as much about your baby's medical condition as possible. [step] Some premature babies will just need more time for their lungs to mature, while others may suffer from more serious complications. The more that you know and understand about what your baby needs, the better you will be able to ensure he is receiving the treatment and care that is best for him.\",\"endings\":\"['[substeps] Find out how long your baby was at the nicu, whether it was initially eight months, or longer. This information will also help you determine how to provide emergency medical care to your baby.', \\\"[substeps] Speak with neonatal nurses and technicians every time they make their rounds. Inquire about improvements or setbacks in your baby's conditions.\\\", 'Consider talking to your pediatrician about whether or not you should bring your baby to the nicu for a visit. [title] After the visit, tour the facility.', \\\"[substeps] The lungs must be united, or the healing process will not be successful. You should be aware of your baby's overall physical state so that you can accurately assess his case.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}