{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9f522d3a-ec72-5552-9f83-398df1778d8a","task_key":"default--validation--3914","task_revision_id":"1","upstream_id":"3914","short_description":"HellaSwag validation 3914","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to treat diaper rash [title] Keep things clean and dry as much as possible. [step] Wash off your baby's bottom with warm water. Resist the temptation to wipe the area if possible.\",\"endings\":\"['A bulb syringe can be used to spray water to the sensitive spots. Gently remove any remaining poop with a dab of a baby wipe or wet cloth.', \\\"[substeps] Changing the baby's diaper can cause diaper rash, but conforms to the basic tenets of hygiene-those should always be washed (and kept dry). Change your baby's dirty diapers everyday.\\\", \\\"The stain is only going to grow if you keep the area clean, and do not rub it. Avoid bumping baby's legs with the fabric softener, as this can irritate the rash, also known as' popeye syndrome'.\\\", 'Use a cleaner like a soft-bristled bath towel, soap and warm water. Make sure to wash your hands before, during, and after touching your baby.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}