{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ac508a3a-23e5-5ea4-8aa5-40b7081d4f87","task_key":"default--validation--19727","task_revision_id":"1","upstream_id":"19727","short_description":"HellaSwag validation 19727","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to go from dark brown to blonde [title] Start with healthy hair. [step] Going from dark brown to blonde requires an application of bleach. If you bleach hair that's dry or processed, you risk damaging the hair further and even breaking it at the shaft.\",\"endings\":\"['Golden brown, surfer hair, olive beach hair, and heavily dyed hair could end up looking ashy, but can retain healthy hair in time. [title] Apply the bleach treatment at least twice a week.', 'To get your hair ready for bleaching, follow these basic rules in the months leading up to your dyeing session : [substeps] Wash your hair with chemical-free shampoo every three days or so. Chemicals can be abrasive, causing hair damage.', \\\"Start with naturally dry hair before trying this method, as it will give your hair less bounce and shape. [substeps] For healthy, clean hair, choose a hair dye kit labeled for those colors you're dyeing.\\\", 'To get started, mix 1 cup bleach and 2 ounces lemon juice. Drink this mixture in your hair for a week before applying extensions.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}