{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a5a34558-d606-5b31-8ab3-3529e5c201c9","task_key":"default--validation--42251","task_revision_id":"1","upstream_id":"42251","short_description":"HellaSwag validation 42251","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to look like a ganguro girl [title] Dye your hair : [step] Either blonde, orange, silver, gray, gold or white, the choice is yours. You may also like to add complimentary highlights or pink hair extensions. If you don't want to dye your hair, you could always buy a wig.\",\"endings\":\"['Dyed hair in japan is known as chapatsu hair. Also, it is popular to not wash your hair often.', 'You can ask your parents for one and see what happens. [title] After all that, do what you want.', '[substeps] Model the look onto a photo or on a fashion magazine. Style your hair in a plunging neckline or pull it back into a ponytail or pigtails, then tie it with a satin ribbon or even a loose half-up.', \\\"[title] Although the sex on this list isn't very identifiable, you may want to try various hairstyles. [step] For example, if you're a brunette, consider colour-blocking your hair hair into washable pink, gold, red, beige or white blonde.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}