{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b4a279af-1a2a-5691-b826-3086ceba2182","task_key":"default--validation--23684","task_revision_id":"1","upstream_id":"23684","short_description":"HellaSwag validation 23684","config":"default","split":"validation","body":"{\"activity_label\":\"Home and Garden\",\"ctx\":\"[header] How to remove the odor of sulfur from clothing [title] Soak your clothes in a baking soda solution prior to washing them. [step] Baking soda is a common household product that is used for much more than baking. Baking soda is commonly used to remove terrible odors and stains, so it's the perfect product to use when you're facing an odor problem.\",\"endings\":\"[\\\"It's a great deodorizer because it chemically neutralizes odors. [substeps] Do not wash your clothes prior to soaking them in baking soda.\\\", \\\"Search your home and purchase a baking soda solution that's specifically designed for oil-based clothing and upholstery. Simply mix four tablespoons (45 ml) of baking soda into one quart of warm water.\\\", 'However, it does not contain enzymes or preservatives that help remove bad smells. Soaking your clothes in the baking soda solution will help open up your pores and make them smell better.', 'To get rid of the smell of sulfur, soak your clothes in water for at least a half hour. Get out some clean, fresh clothes and rub them over areas of concern.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}