{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"73885315-6c98-52e3-97ea-0b520fead5b4","task_key":"default--validation--28303","task_revision_id":"1","upstream_id":"28303","short_description":"HellaSwag validation 28303","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to reduce frizz in wavy hair [title] Shampoo and condition with sulfate-free products. [step] Sodium laureth sulfate and sodium lauryl sulfate are common ingredients in shampoos and conditioners, but sulfates can damage hair and cause frizz. If your current products include these ingredients, replace them.\",\"endings\":\"['Wash and dry your hair as you normally would, but shampoo and condition it as you would your regular hair. Hair needs to be conditioned from the roots to the tips, although being pressured to shampoo and condition increases frizz in hair.', 'Look for new products that list glycerin as one of the top ingredients, since glycerin can deeply hydrate and protect your hair. Avoid shampoos that advertise as \\\" clarifying \\\"-these will strip moisture from your hair.', '[substeps] Never shampoo, since the resulting chemicals can cause frizz. Excessive sulfates may leave a lasting damage on your hair.', '[substeps] Aim for shampoo with sulfates-free ingredients. Check the \\\" hair products included \\\" section of your package of shampoo and conditioners.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}