{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"53d2c805-557e-5ff7-babd-22c3a6139a56","task_key":"default--validation--1659","task_revision_id":"1","upstream_id":"1659","short_description":"HellaSwag validation 1659","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to henna your hair red [title] Consider your natural hair color. [step] While true henna has a reddish, coppery tone, the color is translucent so it blends with your hair color. That means it won't look the same on everyone.\",\"endings\":\"[\\\"Dye your hair the same color, however, and you'll get red streaks. [substeps] Coloring your hair a reddish color looks the same but won't look like henna.\\\", \\\"The lighter your natural hair color, the more vivid red your hair will be. With very dark hair, henna likely won't impart much color, so you'll just wind up with added shine.\\\", \\\"[substeps] If you've had years of hair that's more mature looking, you may consider adding a more solid color to your hair. For example, if you're blonde, hair that's been dyed silver, is usually red.\\\", 'It tends to stick out nicely between dark brown and light brown hair. [substeps] Henna comes in many different varieties from bright red to neon red.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}