{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9b731a1c-346f-597f-861a-c8ac69ea81ff","task_key":"default--validation--18027","task_revision_id":"1","upstream_id":"18027","short_description":"HellaSwag validation 18027","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to tease your hair without damaging it [title] Shampoo your hair. [step] Choose a shampoo that strengthens hair. This will ensure your hair is strong enough for teasing.\",\"endings\":\"['A few to try include fiberstrong, aveeno nourish + strengthen, and pantene pro-v full and thick. [substeps] Many traditional shampoos strip hair of its natural oils.', 'Cover your roots with a shower cap or place a small handful of curlers at the root of your hair. Shampoo your hair twice a day with this shampoo.', \\\"You don't want to finish your hair with sulfates, which can damage hair. Use a section of hair about 15-20 inches (37-51 cm) high and spray you scalp with this product.\\\", \\\"[substeps] It's not necessary to shampoo with this product, since you won't get it because people at some stores may forget that some hair products are just meant to help protect your hair from heat and peroxide. [title] Apply a leave-in conditioner.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}