{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a88c0c4a-5649-529a-911a-67ee82cb29e2","task_key":"default--validation--49969","task_revision_id":"1","upstream_id":"49969","short_description":"HellaSwag validation 49969","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to decide whether or not to get your ears pierced [title] Consider your age. [step] There is no legal age restriction on when you can get your ears pierced, but you will need signed consent from a parent if you are under the age of sixteen. The average age that people get their ears pierced is seven, but it ranges from infant to adulthood.\",\"endings\":\"['If you are under the age of eighteen, and have put in hours of work on your ears, you are legally at the age when you could get your ears pierced. [substeps] Your peers are required to consent as well.', \\\"[substeps] If you are in school it is important to consider your school's rules on body piercings. If they are not allowed, you might want to wait to get them pierced.\\\", '[substeps] While your hearing just increases with age, you will need to have pierced your ear as a teenager to eventually want your ears pierced again. Because of this, you will probably need permission first before you can get your ears pierced permanently.', 'Anyone over the age of seven could get pierced, except anyone older than six months old. Do not be afraid to ask your parents or guardians for the consent.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}