{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"403cc3df-56a0-5cf1-8d5b-50a52266f91d","task_key":"default--validation--44931","task_revision_id":"1","upstream_id":"44931","short_description":"HellaSwag validation 44931","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to look like ashley barnum from' perfect ' [title] Get the look. [step] Ashley has blonde hair that ranges from light brown to almost white-blonde near her face. It's described as being' surfer girl' hair, so you should try using the product' surfer hair' by garnier.\",\"endings\":\"['She also has super-shiny and glossy hair, and it is revealed in the book that she rinses her hair with white vinegar so that it becomes shinier. Now this actually works, so consider it: you will need 1 part white vinegar mixed with three parts cold water.', \\\"For kit kerr, you need to mix emo' surfer' with ash blonde, but make sure you show your true color. Ashy hair works best, but you can try out the' pure girl' look for makeup and powdering.\\\", \\\"If you can't find this extremely attractive look, use straighten-up shampoo and conditioner. If you don't like the appearance of her hair, have a good waxing or body hair section done, with a paddle-like shape and wavy roots, to create this look.\\\", 'Hazel eyes that are never quite big are her signature. Look for a hair dye made for fair to medium hair.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}