{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a514ef3f-662b-544b-933c-db2fee206b47","task_key":"default--validation--15039","task_revision_id":"1","upstream_id":"15039","short_description":"HellaSwag validation 15039","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to care for an auricle piercing [title] Wash your hands before handling the piercing. [step] Never touch your piercing with dirty hands. Wash your hands thoroughly in soap and water before you need to handle your piercing for cleaning.\",\"endings\":\"['The ring may have a tag that reads \\\" isotretinoin piercing. \\\" [substeps] You can use gloves or sterile gauze to wash your hands, but keeping them clean can help the piercing heal faster.', \\\"A few minutes before you get started, scrub your piercing with a soft, paper towel. [substeps] It's normal for some women to scratch the area after performing this procedure.\\\", \\\"[substeps] In general, even when your hands are clean, avoid touching your piercing unless it's necessary for cleaning. [title] Wash your piercing with soap and water twice a day.\\\", 'Excessive washing of your jewelry or hands can also dry out the piercing and potentially damage it. [substeps] Prewash your hands with soap and water before and after touching or carrying any piercing, or before storing them under your clothes.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}