{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b54acbb7-1680-5ba6-be24-37000f190775","task_key":"default--validation--21312","task_revision_id":"1","upstream_id":"21312","short_description":"HellaSwag validation 21312","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to manage thick hair [title] Wash your hair at least twice a week. [step] If your hair is especially unmanageable, wash it every other day. When left unwashed, thick hair can build up grease and grime, and it can tangle wildly out of control.\",\"endings\":\"['Too much washing can also leave a damaged hair area looking misshapen, split, or limp. Let your hair air dry overnight, since it can become oily, greasy, and dry.', 'You should wash your hair almost once a week. [title] Use a sulfate-free shampoo, and make sure it is labeled as sulfate-free.', \\\"Ask your barber to shampoo and condition your hair every other day. [substeps] If you're planning on dying your hair while you're out, use shampoo once a day and conditioner at least once per week.\\\", \\\"Use shampoo and conditioner, but not every day. Shampoo helps keep your hair from getting too greasy, and conditioner helps tame it so that it doesn't grow too wild.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}