{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d46d689a-82d3-5ce4-afd9-86872fcfdb01","task_key":"default--validation--12720","task_revision_id":"1","upstream_id":"12720","short_description":"HellaSwag validation 12720","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to take care of pearls [title] When you put them on, wear them after you're done with everything. [step] When you're taking everything off, take them off first. As an organic gem composed of calcium carbonate, pearls are more vulnerable to the chemicals found in cosmetics, hair spray, and perfume.\",\"endings\":\"[\\\"If you have 1 large pearl, now would be the time to invest in 10 more, within the first 20 years. Just like any other stone, pearls are sometimes exposed to general pollutants, which mean they're more susceptible to infection and, less importantly, to degradation.\\\", 'Dress, style your hair, apply your make-up, and spray on your perfume before you put on any pearl jewelry. [title] Limit your use of pearl rings and bracelets.', \\\"Stock a small jar and use old pearls as you find them, because they can keep from breaking. A spray bottle should be sufficient, but if you'd prefer to use a porcelain one, stock your applicator brush in a medium-sized jar.\\\", \\\"Generally, try wearing your pearls after you've finished bathing. [substeps] Those with olive oil removed earlier, and those without more exposure to the chemicals, often achieve a gloss that naturally helps conceal silver.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}