{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a40eaa96-40c4-569d-87dd-87e09a1c12ab","task_key":"default--validation--2116","task_revision_id":"1","upstream_id":"2116","short_description":"HellaSwag validation 2116","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to prevent cradle cap [title] Purchase a mild shampoo safe for your baby. [step] Using a mild baby shampoo is always best for your baby, unless your doctor recommends something different. Pick one that is labeled for babies and says \\\" mild \\\" or \\\" gentle \\\" on it.\",\"endings\":\"[\\\"These shampoos are safe on babies. Products like these may irritate your baby's skin because they're too soft or rough to have a good feel.\\\", \\\"[substeps] Avoid shampoos containing salicylic acid or any others that have added acids. It is safe to use on babies' hair while pregnant, and infants should rarely be shampooed after delivery because this can cause hair damage or even hair loss.\\\", 'Using a baby shampoo that is rated for babies should keep babies from getting cradle cap at all costs. [substeps] Look for a shampoo with a gentle.', \\\"[title] Wash your baby's hair once every two or three days. [step] Cradle cap is not directly caused by allergies or not bathing your child properly.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}