{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d4e71af2-78cd-5b13-ab5e-f932485c07b8","task_key":"default--validation--31930","task_revision_id":"1","upstream_id":"31930","short_description":"HellaSwag validation 31930","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to dress taller [title] Wear monochromatic or low-contrast color schemes. [step] Wearing a single color lengthens your silhouette by creating a stark vertical line from head to toe. Neutral colors within the same color spectrum have the same effect.\",\"endings\":\"[\\\"[substeps] You don't have to wear everyday shirts, tank tops, leggings, jeans, and other places you might be. Pair a colorful t-shirt with a pair of skinny jeans to complete a cubical look.\\\", '[substeps] Try pairing a baggy black shirt or a t-shirt instead of a suit jacket. If you want to look taller, choose clothing that is a little, but no more fitted than the article of clothing.', \\\"Even colors that complement your outfit's appearance are not good for you. You can boost your overall effect by wearing some neutral shades to balance out the contrast.\\\", 'Dark color schemes are more effective at creating the illusion of height than light or vibrant colors. [substeps] For example, wear a deep navy blazer over a dark blue button-down dress shirt with fitted navy trousers.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}