{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"95e9224f-8971-595c-8dfb-8713ea2323e8","task_key":"default--validation--32186","task_revision_id":"1","upstream_id":"32186","short_description":"HellaSwag validation 32186","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to wash braids [title] Choose the right shampoo and conditioner. [step] While any shampoo or conditioner will work, it is better to use moisturizing shampoos and conditioners, especially if your scalp is dry and itchy. Some products such as shea moisture african black soap deep cleansing shampoo and giovanni tea triple treat shampoo are made specifically for dry scalps and thick hair.\",\"endings\":\"['[title] Apply a generous amount of shampoo onto the scalp, remembering to cover the nape and hairline. [step] Gently massage every inch of the scalp, paying close attention to itchy areas.', \\\"These products cause your hair's natural oils to soak up. [substeps] Make sure to read the instructions that come with the shampoo and conditioner to make sure you use the right oils.\\\", \\\"[substeps] To prevent yourself from getting scalp damage, store your braids in a big container. Cover your braids with a towel and allow them to air dry as soon as you're done.\\\", '[title] Shake the hair gently for about 20 seconds. [step] This gives the product time to seep out, and some of the water and oil will come out.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}