{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3ebd3aec-bdfa-5347-90ac-f06ff12c63f7","task_key":"default--validation--34993","task_revision_id":"1","upstream_id":"34993","short_description":"HellaSwag validation 34993","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to brush hair with boar and nylon [title] Comb your hair before wetting it. [step] If you have a hard time getting your hair wet, try combing it under running water as well. [title] Use a shampoo that is not damaging for your hair.\",\"endings\":\"['[step] This will help prevent water buildup in your hair when it is wet, and it will help ensure that your hair gets the foamy, frizz-free volume that it needs when it is dry. [substeps] Be sure that the shampoo is made specifically for your specific haircut.', '[step] Some shampoos dry your hair out, making it brittle and unmanageable. Massage your scalp gently, using back and forth motions rather than circular motions that twist your hair and break it.', '[step] Go for a lightweight shampoo because boar/nylon shampoo is very absorbent, which makes the hair really delicate and could result in premature bleaching. [substeps] Ask your hairdresser for advice, or they may be able to recommend one that is good for you.', '[step] Shampoo at least spritz on your roots/tips and do not shampoo before you shampoo. [substeps] Using an oil or coconut works best.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}