{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f3f33184-56a6-5f28-8f3d-1b002a9977dd","task_key":"default--validation--19909","task_revision_id":"1","upstream_id":"19909","short_description":"HellaSwag validation 19909","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get rid of body odor naturally [title] Bathe or shower regularly. [step] Since bacteria reacting with sweat produced by your sweat glands causes body odor, it is important to bathe or shower regularly. Use a gentle, plant-oil based soap and lather up.\",\"endings\":\"['One of these soaps lubricate the full surface of your body making it easy to scrub or shower. [substeps] Breast milk, pancetta, and salicylic acid soaps should be avoided if you have additional body odor.', 'Do not scrub your skin with the soap. Do not use deodorant (which will dislodge the oils) as this can result in a build-up of body odor.', 'The greater the amount of lather and the longer you lather up, the more effective you are likely to be in removing bacteria from your skin. [substeps] Not all soap is antibacterial, nor do you necessarily need antibacterial soap.', '[title] Use a mix of soap and water. [step] Active and neutral bacteria that can cause body odor are also added to these products.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}