{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8e3c173f-d21b-5852-8daa-3196521b1944","task_key":"default--validation--38329","task_revision_id":"1","upstream_id":"38329","short_description":"HellaSwag validation 38329","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to do eye makeup for blue eyes [title] Use eyeshadow primer under your eyeshadow. [step] This will help enhance the color of your eyeshadow, making it appear brighter, which in turn will also make your eyes appear brighter. [title] Choose eyeshadow with contrasting colors.\",\"endings\":\"['[step] One of the best ways to bring out the blue in your eyes is to use contrasting colors. This means choosing eyeshadows in neutral and earth tones, warm colors, and colors opposite of blue and green on the color wheel.', '[step] Avoid black, or pink, however. This will only enhance the orange/black look without adding any contrast.', '[step] You may find it easier to use contrasting colors if your eyes are slightly different. Then, when applying eyeshadow primer for blue eyes you may choose a less neutral shade, such as beige or brown.', \\\"[step] Go to the store, if you have one, and figure out what color eyeshadow you'd like. It should look one color but not several different colors, as this will make your eyes look noticeably brighter.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}