{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"75d70b08-5375-5f01-b8b0-dc75cbe7b428","task_key":"default--validation--47869","task_revision_id":"1","upstream_id":"47869","short_description":"HellaSwag validation 47869","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to tame cowlicks [title] Wet your hair. [step] It is easier to work with wet hair. Once the roots dry, the hair will be set and difficult to style.\",\"endings\":\"['[substeps] If you plan to work with damp hair, you can water the hair, but use a detangling spray to get your hair as dry as possible. Shampooing your hair while it is wet will make all the tangles out of your hair.', \\\"Shampoo your hair and apply a leave-in conditioner. While you can use conditioner every day, it's best to start with wet hair.\\\", 'Shampooing wet hair takes anywhere from an hour to a very long period. [substeps] Start with your roots and work your way down.', 'You can style your hair just out of the shower, or wet your hair in the section of the cowlick using a spray bottle. [title] Dry your hair with a hair dryer on medium heat.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}