{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"043a0e76-aa65-5d20-9d40-cf5a1f03331b","task_key":"default--validation--37304","task_revision_id":"1","upstream_id":"37304","short_description":"HellaSwag validation 37304","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to gauge your ears [title] Get your ears pierced at a trustworthy location. [step] Although you can stretch your ears at home, you will need to get them pierced at a professional establishment. Piercing your ears at home increases your risk of infection, especially if you are stretching your ears afterward.\",\"endings\":\"['[substeps] Make sure there is no noise coming from your ear. Ask your piercer about this option if they think you might be allergic.', 'You will be unable to use the same sterile equipment and technique as a licensed professional. [title] Wait 6-10 weeks after piercing your ears to stretch them.', 'Consider : [substeps] An earring option-hoops must be too big to hold in your ears or too small to fit snugly into your ears. You can find fake hoops at a fabric or online jewelry store.', '[substeps] If you know a professional that is used to piercing ears, you will want to ask them to get your ears pierced professionally at a well-known venue that does not have a lot of competition. [title] Understand that you can risk a more serious medical infection by having an ear piercing that is a salon-quality piercing.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}