{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8dadb6fd-46a9-54a2-bd04-5461272ff4cc","task_key":"default--validation--15081","task_revision_id":"1","upstream_id":"15081","short_description":"HellaSwag validation 15081","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get loose waves [title] Start with completely dry hair. [step] Second-day hair sometimes works better for styling, so if you can, wait a day after washing your hair. This will help your waves stay in place longer.\",\"endings\":\"['[title] Put in a spray bottle of mousse. [step] While light hairspray may not provide foam, a bit of hold can help, which will hold the waves when you straighten your hair.', \\\"[substeps] If you want curls that aren't yet in place, you'll have to sacrifice curls by just getting a light texturizing product. You can use a texturizing spray to tame unruly waves.\\\", 'Dry hair is easier to style by itself than wet hair, so it is important that you find out how to do it. [substeps] Use a smoothing serum, a shine serum and a thin, oil-free water-based product.', \\\"[substeps] If your hair is naturally very curly, [straighten your hair | straighten it] before continuing. If you want loose waves, you'll need to start with either straight or slightly wavy hair.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}