{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"549bb087-d880-5550-92f4-b6163d27b550","task_key":"default--validation--38085","task_revision_id":"1","upstream_id":"38085","short_description":"HellaSwag validation 38085","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get hair dye off your face [title] Buy a toothpaste to remove the hair dye stain. [step] Any non-gel toothpaste will probably do, since they all have abrasive properties, but choose one that has baking soda in it. They tend to be even more abrasive, and baking soda has stain-lifting properties in it.\",\"endings\":\"['[substeps] If you used shaving cream as part of your bleach treatment, buy a regular toothpaste that has baking soda as well as salt in it. Salt is not only abrasive but also compounds the color of your new dye.', \\\"[substeps] Don't be too harsh with this method unless you are in a hurry or want another mod. Try using a toothpaste specially formulated for your skin, and be sure to rinse it off before getting started.\\\", '[substeps] If your hair is strawberry blond, try a toothpaste made from strawberry. For darker hair, try tea tree oil.', \\\"[title] Apply a thin layer of toothpaste over the stained area of skin. [step] You can use your fingers if you don't mind getting a little messy; otherwise, use a cotton ball.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}