{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f88225b3-0eeb-5cb8-a153-f2ada8debaae","task_key":"default--validation--39088","task_revision_id":"1","upstream_id":"39088","short_description":"HellaSwag validation 39088","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to remove blonde hair dye [title] Go for a color remover. [step] You can buy hair color remover at most drug stores and beauty supply stores. You can follow the directions on the bottle to figure out to use it to remove color from your hair.\",\"endings\":\"[\\\"Rinse your hair and towel dry it, taking care to let the dye dry thoroughly. You can then rinse your hair again and apply some shampoo to the dyed hair, to make sure it isn't dry or brittle.\\\", 'Usually, you apply remover to your hair and let it sit for a specific timeframe before rinsing it out. [substeps] Make sure to get the right color remover for your hair type.', \\\"It will likely take a little trial and error to find the right color. It may also give you a little bit of whitening experience, so don't be afraid to experiment.\\\", 'Mix one part peroxide and one part water in a tub or sink. You want the peroxide to be stiff and to stay there.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}