{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"20f01b4d-433a-5d22-9e62-4aae263d4c27","task_key":"default--validation--296","task_revision_id":"1","upstream_id":"296","short_description":"HellaSwag validation 296","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get a medusa piercing [title] Familiarize yourself with medusa piercings. [step] Medusa piercings are usually a single stud piercing found in the center of the lip just above the lip line. A medusa piercing would be found on the flesh just above your lip and below your nose.\",\"endings\":\"[\\\"This is a very noticeable piercing, so it's hard to hide or minimize. However, if you want a bold look, it can be a great choice.\\\", 'A medusa piercing has three rows of smaller rings at each end, and two rows of larger ones on either side of the lip. [substeps] Medusa piercings are usually darkened or bleached to tint the piercing blue, lavender, or green.', \\\"Medusa piercings aren't easily missed, so you may spot them either on your neck or on your lips. [title] Visit an ice cream store with medusa piercings.\\\", \\\"Make sure you know how to get a medusa piercing, so you won't end up wasting any time. Take a second look at medusa piercings, and make sure you're not allergic to them.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}