{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4dcdd897-77cb-5110-afdb-cfa90f4e1fe0","task_key":"default--validation--50192","task_revision_id":"1","upstream_id":"50192","short_description":"HellaSwag validation 50192","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to bring out green eyes [title] Wear shirts and jackets in any shade of green. [step] Whatever clothing item you wear closest to your irises-the green-colored part of your eyes-will emphasize their color. Since many shades of green will make green eyes pop, try wearing shirts and jackets in your favorite shade.\",\"endings\":\"['[substeps] Fabric patches, especially those in bold patterns, are also an excellent way to highlight green eyes. If you notice that your clothing items are early in the morning, you can adjust what time to change the outfit.', 'For example, try wearing a black lace-up tee. Mixing and matching a solid color and a light shade of green can vastly change your look.', 'Just be sure to avoid bright shades like neon and kelly green, which can actually make your eyes look dull. [substeps] For example, put on a deep green button-down shirt or a green t-shirt.', \\\"Try neon black, neon pink, turquoise, red, and blue. [substeps] Don't forget to wear bright colors on t-shirts and jeans, too.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}