{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ed6de1ee-c7ad-507d-8168-b0bf464ec4d2","task_key":"default--validation--49700","task_revision_id":"1","upstream_id":"49700","short_description":"HellaSwag validation 49700","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to straighten thick, curly hair without damaging it [title] Use smoothing, sulfate-free shampoos and conditioners. [step] While shampoo and conditioner alone won't straighten your hair, there are few types to look for that are good for keeping straightened hair healthy. Products labeled \\\" smoothing \\\" provide lots of moisture to your hair and prepare it for straightening.\",\"endings\":\"['After washing your hair, brush conditioner through your hair with a paddle brush and rinse it with lukewarm water. [substeps] Make sure your hair is already detangled before brushing conditioner through it.', '[substeps] If your hair tends to be naturally coarse, look for natural shampoo and conditioners made specifically for working with this. Shampoo will help soften your hair and help avoid the need to untangle it.', '[substeps] Choose a deep conditioner each time you wash your hair so it can hydrate and protect it from damage and tangling. Avoid products that contain sulfates, other ingredients that may damage thick hair.', 'Do not use sulfates if you plan to heat your hair specifically. You can find products designed specifically for straightening hair with heat and other products that will dehydrate your hair.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}