{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9202bba7-cee7-5b2c-ba2a-02e781feccd5","task_key":"default--validation--1764","task_revision_id":"1","upstream_id":"1764","short_description":"HellaSwag validation 1764","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to shampoo your hair [title] Select a moisturizing shampoo for coarse or kinky hair. [step] If you have coarse or kinky hair, you'll want a shampoo that amps up the moisture in your hair. Shampoos with glycerin, panthenol, or shea butter are good for coarse or kinky hair because they infuse extra moisture into the hair.\",\"endings\":\"[\\\"[substeps] You'll also want a spf of 30 or higher to protect it from harsh uv radiation. [title] Wash your hair regularly, or spritz with body spray.\\\", '[substeps] Look for shampoo specifically designed for coarse or kinky hair. Find a product that is made from organza or greek yogurt.', 'Products that include these ingredients can be applied to wet hair and do not cause damage. [title] Buy shampoo formulated for coarse or kinky hair.', '[title] Try a volumizing shampoo for fine and/or thin hair. [step] If you have fine or thin hair, look for a shampoo that adds volume without weighing your hair down.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}