{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5d18f3a8-b376-5ecf-9926-d45040b3c892","task_key":"default--validation--36559","task_revision_id":"1","upstream_id":"36559","short_description":"HellaSwag validation 36559","config":"default","split":"validation","body":"{\"activity_label\":\"Food and Entertaining\",\"ctx\":\"[header] How to dry up poison ivy rash [title] Wash your skin. [step] As soon as you realize that you've accidentally come into contact with poison ivy, wash your skin very thoroughly. Use lots of warm, soapy water.\",\"endings\":\"['This could mean spritz of water, wash for two to three hours, or even more before proceeding to the next step. [substeps] The best time to dry up poison ivy rash with soap and water is when your skin is very moisturized.', \\\"If you can, wash within the first 30 minutes of touching the poison ivy. If you're still outdoors, find a stream or creek.\\\", 'Use 1 hand and a small amount of gentle soap, then scrub your skin vigorously for 10 minutes at a time. [substeps] Some follow up sprays are sold as \\\" steam inversions \\\" or \\\" gels, \\\" which means you process and moisturize your skin using the steam method.', \\\"Rinse in a sink or any container you don't mind getting soapy. [title] Step into the shower and wash off all of the dead skin cells.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}