{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1c16bf08-2ef4-55fd-b7a4-1162fa0e85ac","task_key":"default--validation--11789","task_revision_id":"1","upstream_id":"11789","short_description":"HellaSwag validation 11789","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to smell good [title] Bathe regularly. [step] On average, you should take a shower every one to two days. Even if you are unable to smell an unpleasant odor on your skin by the end of day two, you should still wash up.\",\"endings\":\"['This will be especially important if you live in a humid climate. Take a shower once a day and, if you cannot wait until the day of day 24 (when the weather is cool enough), twice a day.', \\\"Showering too often is your body's way of telling your body that it needs to take out endorphins, or oxygenates, to make you smell great. [substeps] Spend time washing your hair twice a day and washing it once every other day with shampoo.\\\", 'Doing so helps revitalize your body; contrary to popular belief, especially the most powerful perfumes, other (and sometimes worst) smells can damage the skin, so you should also use warm water to keep your body and hair moisturized. [substeps] To use warm water, consider using a bar of soap, which is available at most department stores.', '[substeps] Bacteria and moisture will build on your skin fairly quickly, causing potential health problems as well as a notably foul odor. Regular bathing dries out the skin and strips it of odor-causing bacteria.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}