{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"dab34e76-f6ea-582a-a5b8-2805a48f62e4","task_key":"default--validation--42297","task_revision_id":"1","upstream_id":"42297","short_description":"HellaSwag validation 42297","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to use a bulb syringe on a baby [title] Consult your pediatrician. [step] You should always consult your pediatrician before administering any type of medication or using any kind of medical device on your baby. Your doctor will be able to diagnose your baby, and provide an adequate treatment regime.\",\"endings\":\"['[substeps] The most common treatment for sad is a breathalyzer reading. However, most medications used in birth control cannot be used on babies with sad.', '[substeps] Your baby should not have symptoms for at least a month and a half. This will allow your baby to adjust to medications.', 'They may also recommend that you keep your baby still for a couple of days after treatment to give blood cells time to fight infections. [title] Introduce your baby to their pediatrician as soon as possible.', \\\"If your baby is severely congested, you doctor might prescribe nose drops, and syringe your baby's nose during the appointment in order to provide immediate relief. Your doctor can also show you how to correctly use the bulb syringe.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}