{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"66063094-88b1-58cf-ba69-153d8668ef61","task_key":"default--validation--13833","task_revision_id":"1","upstream_id":"13833","short_description":"HellaSwag validation 13833","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to keep bleached hair healthy [title] Stick with sulfate-free products made for color-treated hair. [step] Sulfates are full of salt, which can dry out and damage your hair. When picking up shampoo, conditioner, hairspray, or other products, read the labels carefully.\",\"endings\":\"[\\\"Only use products that contain sodium lauryl sulfate. Avoid products that are 100% sodium lauryl sulfate, such as ceylon, l'oreal, and hemp seeds.\\\", 'As long as you check the words first to see what the product contains, you have the option of bleaching your hair. [substeps] You can also purchase products meant for dark hair.', 'The salicylic acid in dry hair is very easily absorbed in bleached hair. [substeps] Before going for a coloring-or bleaching treatment, consider thoroughly washing your hair.', 'Avoid anything containing sodium lauryl sulfate, ammonium laureth sulfate, or sodium laureth sulfate. You should also make sure that every product you use is formulated for use on color-treated hair to ensure your locks remain healthy.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}