{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"496af009-1cfb-52cb-8707-07cd3f6b9a33","task_key":"default--validation--24996","task_revision_id":"1","upstream_id":"24996","short_description":"HellaSwag validation 24996","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to use an infant nebulizer [title] Put the nebulizer on the baby. [step] An infant will inhale the medication in a mist provided by the mask. Read and follow the manufacturer's instructions and any additional advice provided by your child's doctor.\",\"endings\":\"[\\\"[title] Hold the device on your baby, then follow these instructions : [step] Place a clean dish towel over the device. Insert a small amount of tsp into the nebulizer and over your baby's head.\\\", '[substeps] Some babies need only 1 dose every 3-4 hours. [title] Watch for trouble breathing and a ringing sound in their ears.', '[substeps] The child should breathe normally while the mask is on. Only four hours have passed since the child first began using the nebulizer, so if someone else has opened it, then your child will usually breathe through the mask.', 'Study pictures or watch a training video to learn how best to use the nebulizer. Most nebulizers are easy to set up.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}