{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5e8bd44d-8c18-5dbd-a437-4e0c79ee4e15","task_key":"default--validation--25319","task_revision_id":"1","upstream_id":"25319","short_description":"HellaSwag validation 25319","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to smell nice [title] Bathe/shower regularly. [step] This will get rid of hormonal odor on your entire body and is essential that you do it daily. If you find this hard to fit into your schedule, try asking a doctor about other procedures.\",\"endings\":\"['[substeps] Before your shower, apply a soothing face cleanser or mild face wash. When you get out of the shower, clean yourself with an enzyme-based soap and body wash.', '[substeps] Don\\\\'t use body wash and shampoo as these can affect your clothes. Try using products from the united states pharmacies, that includes a \\\" bath/shower \\\" rule.', 'Make sure to wash the problem parts of your body carefully. These parts include the armpits and genitals.', '[title] The next time you shower, use a soothing, natural cleanser. [step] Use full body washing (not bubble baths or face washes) and 1/2 inch clarifying shower gel.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}