{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"60a7f552-ff54-547a-9e3f-3760f0c99ab7","task_key":"default--validation--5780","task_revision_id":"1","upstream_id":"5780","short_description":"HellaSwag validation 5780","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to put together a relaxed wardrobe [title] Choose colors that are relaxed. [step] Look for colors that suit you well but that fall within the relaxed range. Relaxed colors include beige, pastels, silver, deep blues and purples, greens and colors of the forest.\",\"endings\":\"[\\\"Creating a relaxed wardrobe involves picking clothes in relaxed settings so you don't focus on getting dressed everyday. [substeps] Pick clothing that's loose but comfortable.\\\", '[title] Choose fabrics that are comfortable and yet sit well on your body. [step] Silks, linen, tencel, cottons, wool and breathable fabrics are usually good clothes for relaxing in.', '[title] Look for garments that line your entire wardrobe. [step] Try pairing shirts and dresses with relaxed clothes.', \\\"[substeps] Don't go for dark colors or bold colors like deep reds, deep blue, purple, or orange, or bright colors like maroon, lime or deep purple. Investing in wardrobe options can ultimately be the best way to relax in relaxed fashion, and to quell anxiety associated with wearing a relaxed style.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}