{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a65925ce-dcbb-5a37-bc00-206ed10ae5db","task_key":"default--validation--37244","task_revision_id":"1","upstream_id":"37244","short_description":"HellaSwag validation 37244","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to dry your hair [title] Pat your hair dry with a towel. [step] If you can, try to use a microfiber towel. Microfiber towels are soft and gentle on all hair types.\",\"endings\":\"[\\\"Avoid using dull towels, since they make hair really dry quickly. [substeps] If you're in a hurry, dampen a microfiber towel with some water and wring it out.\\\", \\\"You don't need to rub the towel over your hair, just pat it dry. [title] Choose a hair shade that reflects well.\\\", 'They are less likely to snag, rip, or tear your hair than regular towels. Microfiber towels can also help reduce frizz.', 'Make sure to pat the towel dry gently and without abrading your hair. After drying, use the apple cider vinegar spray to gently splash your hair with cool water.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}