{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2ac47982-a127-5466-9da7-55b64072d363","task_key":"default--validation--43196","task_revision_id":"1","upstream_id":"43196","short_description":"HellaSwag validation 43196","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to achieve pastel hair [title] Choose your bleach. [step] If your hair is not platinum blonde or white, you will need to bleach your hair. The lighter your hair, the better the pastel color will take.\",\"endings\":\"['If this is your first time bleaching your hair, start with a bleach kit. The kit contains dye and peroxide to bleach your hair.', 'If your hair is platinum blonde, it will not show a lot of pastel at all. If your hair is white blonde, it will show any tint of pastel color! [title] Use shampoo and body wash.', 'However, light blonde hair tends to be bleached out. Look for cakeboards, which hold up better to bleached hair than wavy hair, but were dyed very differently.', 'Do not dye your hair blonde, however, or you may dye the strands. You will need to get your hair bleached if you want a pale look.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}