{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f3866777-ad83-5ca1-9abd-c43b1a01df09","task_key":"default--validation--36368","task_revision_id":"1","upstream_id":"36368","short_description":"HellaSwag validation 36368","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to bleach hair blonde [title] Start with healthy hair. [step] Don't dye or otherwise process your hair in the months leading up to the bleaching. Bleaching your hair will work much better if your hair is relatively strong and unprocessed.\",\"endings\":\"['Your hair will withstand the rigorous bleaching process better, too. [substeps] Use natural shampoo and conditioner for strong hair.', 'Hair that is processed the same way too many times and then undermines the color will look mostly the same. [substeps] You can also avoid bleaching by eating a healthy diet and exercising frequently.', \\\"Check your hair a week after you've dyed it to see how it reacts before bleaching. Look at your hair every day before you begin.\\\", 'However, even if you cut your hair short, skip this step. [substeps] If you dyed your hair blonde in the months leading up to the bleaching, skip this step.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}