{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4d74619c-4087-5ec5-b8d9-c11b8e355213","task_key":"default--validation--25255","task_revision_id":"1","upstream_id":"25255","short_description":"HellaSwag validation 25255","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make a snake braid [title] Start with hair that's clean and dry. [step] The snake braid will work best with clean, healthy, and moisturized hair that's completely dry. In the shower or bath, wash your hair with a mild cleanser to remove dirt, oil, and styling products.\",\"endings\":\"['Do not use very much, as extra volume on your hair could make it look cakey instead of healthy. [title] Unravel the hair as the braids usually do.', \\\"Use a comb to gently detangle the hair that's tangled. [substeps] If you need extra help removing hair in a spiral braid, purchase a long plastic comb.\\\", \\\"[substeps] Condition your hair with your favorite conditioner, and after you rinse it out, towel dry your hair and let it air dry. If you're in a rush and need to blow dry your hair, apply a heat-protecting product beforehand.\\\", '[substeps] Take care to avoid pulling your hair under the towel when you wash it. Also, don\\\\'t submerge the towel in water because you don\\\\'t want the water to \\\" smudge \\\" the hair.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}