{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"df46f401-3901-53ec-bea1-33817cb66d70","task_key":"default--validation--6986","task_revision_id":"1","upstream_id":"6986","short_description":"HellaSwag validation 6986","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to clean your teeth after wisdom teeth removal [title] Change gauze as instructed by your doctor. [step] After your surgery, your doctor will pack your mouth with gauze over the surgery site. You can generally replace these after an hour or so, if you need to.\",\"endings\":\"['If you are in a hospital, your doctor will usually let you know what is part of the periodontal collection. Possible items include : [substeps] A cotton swab.', 'If you continue to bleed, change your gauze packs every 30-45 minutes and apply gentle pressure. You should not bleed for more than a few hours after surgery.', '[substeps] If you do not have time to change gauze, wash your mouth with water and go to the bathroom before you remove it. Then, start gently cleaning your mouth, following directions provided in the gauze.', '[substeps] The gauze will prevent dirt and bacteria from entering the surgical site and from aggravating tooth extraction procedures. You can wash the gauze with warm water before you remove it so your mouth stays hydrated.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}