{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"489d2ace-4591-598e-a591-27ad94549ed6","task_key":"default--validation--11529","task_revision_id":"1","upstream_id":"11529","short_description":"HellaSwag validation 11529","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to tell if a tattoo is infected [title] Wait a few days before coming to any conclusions. [step] The day you get a tattoo, the entire area will be red, slightly swollen, and sensitive. New tattoos will be somewhat painful, about as sore as a severe sunburn.\",\"endings\":\"['If the tattoo is not infected, it will likely burn within the first six days. Simply return the tattoo to a reputable pharmacy and, if an attempt to remove it looks infected, take it to a physician.', 'This usually abates about 10 days after the tattoo, but you still may need to see your doctor. The following days will usually be the most likely day for the tattoo to appear infected : [substeps] The sun exposure is the most severe (this is usually around mid-morning or afternoon).', \\\"If you are concerned about your skin's perceived ability to heal or if you suspect something is seriously wrong, avoid handling the tattoo until that day. [substeps] Best to avoid touching your tattoo if it has already healed.\\\", \\\"In the first 48 hours of getting a tattoo, it can be very difficult to determine whether or not an infection has set in, so don't jump the gun. Maintain a proper tattoo aftercare procedure and adopt a wait and see policy.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}