{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d628e2ce-bc2f-5164-b161-684ff4d6d662","task_key":"default--validation--48418","task_revision_id":"1","upstream_id":"48418","short_description":"HellaSwag validation 48418","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to clean body jewelry [title] Wash your hands. [step] Anytime you touch your jewelry, it's possible you are transferring germs to the piercing site. While you should avoid touching it in general, it is especially important to only handle body jewelry with clean hands when you are about to clean it.\",\"endings\":\"[\\\"[substeps] Don't remove or clean jewelry before washing it. This can cause more infection or you should not hold onto jewelry.\\\", 'Use a basic antibacterial soap and dry your hands with paper towel or a clean towel. A towel that you already dry your hands on frequently can have bacteria that has accumulated on it.', 'Always wash your hands before or at least after touching a piece of jewelry. [substeps] In general, if you touch or hold clothing in your hands, make sure to wash your hands before and after touching it.', \\\"If you don't have clean hands while you are working, then that will help make cleaning the jewelry even more smooth. [substeps] Use soap and water to wash your hands.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}