{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2bab81c1-23b6-537c-8626-7f32b600b203","task_key":"default--validation--31946","task_revision_id":"1","upstream_id":"31946","short_description":"HellaSwag validation 31946","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to deal with vaginal dryness [title] Try lubricants. [step] If your vaginal dryness is a problem during intercourse, using lubricants can help temporarily alleviate the problem. [substeps] Lubricants can be purchased online, in pharmacies, and can also be bought at sex shops.\",\"endings\":\"['For those who do not have oral health issues, lubricants are most recommended to assist with desensitizing your vagina. Studies have shown that men who regularly use lubricants over the course of intercourse have greater success in treating vaginal dryness.', 'A variety of lubricants may offer greater benefits in reducing the dryness associated with your vagina. These kinds of lubricants include silicone, egg, acetone, amino acids, and polymers.', 'Lubricated condoms can also be purchased to alleviate vaginal dryness during intercourse. Lubricants should be applied directly to the vagina shortly before intercourse.', 'If you have gynecomastia, try switching to a lubricant, which is a substance made by the blood glands in your vagina. [title] See your doctor if your dryness persists.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}