{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6c33854e-7e33-5e4b-936e-038f328b3e27","task_key":"default--validation--37930","task_revision_id":"1","upstream_id":"37930","short_description":"HellaSwag validation 37930","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to do ombre highlights [title] Start with brushed, dry hair. [step] You can wash your hair beforehand if you want to, but make sure that it is completely dry and neatly brushed. This method will work the best on virgin hair, but you can try it on hair that has been previously dyed.\",\"endings\":\"['Keep in mind that the results may not be the same. [substeps] If working with hair that has been previously dyed, it may be best to consult a professional hair stylist.', \\\"[substeps] For the best results, use the right shampoo. Toners like clarifying are available over-the-counter, but if your hair isn't as curly as it seems, make sure to rinse it after washing.\\\", '[substeps] If you normally wash your hair with your regular shampoo, do so now. This will let the hair absorb the shampoo and small oils, which will help appear thinner later on.', '[title] Wash your hair with shampoo and conditioner. [step] Mix one part shampoo to three parts conditioner in a small bowl.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}