{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bb1c78c0-a927-59fc-a3a3-c44c8e2f083b","task_key":"default--validation--25678","task_revision_id":"1","upstream_id":"25678","short_description":"HellaSwag validation 25678","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to prevent natural blonde hair from darkening [title] Use purple shampoo. [step] A number of purple shampoos--literally, the shampoo is purple--are available at salons and drugstores, and they work to counteract brassiness in blonde hair. [substeps] \\\" brassiness \\\" is when blonde hair takes on an unflattering yellow or orange tone.\",\"endings\":\"['This occurs when light-colored hair has yellow highlights instead of dark hair. Purple shampoos work to neutralize brassiness by absorbing light, but the solution is not enough to stop brassiness.', \\\"This is why it's important to use 1 or 2 different shampoo brands to really minimize brassiness. [title] Wear a wide brimmed hat.\\\", 'It is usually accompanied by a tint of green in the fade. You can buy hair masks to help combat brassiness or darker hair colors in this category as well.', 'It results when the blue molecules in hair begin to fade and leave the yellow and orange molecules to shine through more strongly. Purple shampoos work by restoring blue tones to the hair, helping to prevent brassiness.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}