{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"832de96e-88e1-5d09-a8a9-ba452d293cb8","task_key":"default--validation--29231","task_revision_id":"1","upstream_id":"29231","short_description":"HellaSwag validation 29231","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to dye your hair brown after it has been dyed black [title] Buy the right products. [step] There are two types of shampoos that will help take color off of your hair. Clarifying shampoo is rich in color-stripping ingredients and dandruff shampoo also helps strip color from your hair.\",\"endings\":\"['[substeps] Clarifying shampoo also washes out dirt and oil from your hair and helps your hair dry faster. You can find clarifying shampoo at most pharmacies.', '[substeps] Paste shampoo is meant to promote shine, while goo gone shampoo is meant to take color off of your hair. [title] Rinse out excess oil and finish with a protective conditioner to boost shine.', 'These shampoos will help break down the color on your hair and get your hair back to its original color. You can also buy conditioner that is not safe for color treated hair.', 'You can find these shampoos at hairsalas or hair-washing labels. [substeps] Clarifying shampoo should be used sparingly and never use more often than recommended.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}