{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6a88e392-2c55-52bd-a397-40ba2bcd0126","task_key":"default--validation--32614--variant-be545eef1cfd","task_revision_id":"1","upstream_id":"32614--variant-be545eef1cfd","short_description":"HellaSwag validation 32614","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to do a professional ponytail [title] Dampen your hair. [step] Slightly wet hair will be easier to shape to the desired style. Don't style your hair straight after the shower, since soaking wet hair breaks easily.\",\"endings\":\"['[substeps] A squirt bottle works well for light dampening. If your hair is dirty or oily, wash it, then wait until it is about 80% dry.', 'Use an oil-free hair spray, and let your hair air dry. Otherwise, your hair will frizz.', \\\"[substeps] If you don't have time to wet your hair, or if you prefer a more professional look, dry your hair immediately after your shower. Make sure you're getting all the moisture out.\\\", \\\"If you want to wake up wet, you can rinse your hair under warm running water. [substeps] You can dampen your hair with a hair dryer, but this will only ensure that the water isn't dripping or freezing in the shower.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}