{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4a55786a-de01-5579-98af-247bff8ae194","task_key":"default--validation--17226","task_revision_id":"1","upstream_id":"17226","short_description":"HellaSwag validation 17226","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to increase oxygen levels in your home [title] Open your windows. [step] You may spend a lot of time indoors, especially in the winter. Open a window in your home to allow fresh, oxygenated air inside.\",\"endings\":\"['If you really like minimizing the possibility of a cold, try turning on some air conditioning or open a window occasionally. [substeps] If you are abroad, place your home in a cooler climate to increase your oxygen level.', 'Standing in your home for extended periods of time can get your heart pumping and increase the level of oxygen in your blood stream. [substeps] Outside, for example, you may want to open your windows often in the morning so you can get some fresh air.', 'If you live in a colder area, you may consider opening your windows manually every half an hour. If you live in a cooler area, use the ac unit that comes with your windows to regulate your air intake.', \\\"If it's warm enough, open two windows on opposite sides of your home to increase air circulation. Try to open your windows for a few minutes 3 times a day, even in winter.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}