{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a5a422fd-3d3e-5eb2-a18d-31f8db7fb026","task_key":"default--validation--39704","task_revision_id":"1","upstream_id":"39704","short_description":"HellaSwag validation 39704","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to treat bleached hair [title] Know that bleaching damages your hair strands. [step] Bleach is a caustic chemical, and it strips color away from your hair. As you can imagine, this is not entirely healthy for it, no matter how fashionable it is.\",\"endings\":\"['Bleaching your hair may cause bright red bumps to form and it may require surgery to get it back to its original shine. Some bleaching products will produce patches and then dry and harden once you leave the salon.', 'Using a repair treatment on your hair shortly after bleaching it can prevent long-term damage and make it easier to treat your hair in the future. Some products to try include : [substeps] Fiber force shampoo and conditioner, schwarzkopf bc repair, aveda dry remedy shampoo, etc.', '[title] Lift your hair upward in the shower after showering. [step] Use enough water to cover your head.', 'Hair dye itself can damage your hair, if combined with the bleaching process. In a scientific experiment, a pair of dead skin bleaches containing latex, gelatin, and peroxide found no harm whatsoever, when combined with bleaching, resulted in a stunning results.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}