{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"de18401d-a8c5-5f85-8cf0-8d44c42c41a5","task_key":"default--validation--50518","task_revision_id":"1","upstream_id":"50518","short_description":"HellaSwag validation 50518","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make hair shiny when air drying [title] Don't skip the conditioner. [step] Using shampoo every time you shower can dry out your hair, but you should condition every time. It will soften your hair, hydrate it, and help smooth the cuticle to create shine.\",\"endings\":\"['[title] Condition your hair every day with a no-frills formula. [step] Both shampoo and conditioner will make your hair shiny.', \\\"[substeps] You don't need shampoo for blow drying if you want your hair to look shiny. A layer of wax or gel will ensure you completely dry your hair.\\\", '[substeps] Try to use shampoo that contains sulfates, which are ingredients in natural oils. Scrub your scalp with your fingers to remove some of the water from your roots.', \\\"Look for conditioners made for your hair type, and make sure you're applying it properly. [substeps] If you have fine hair, avoid applying conditioner to your roots.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}