{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"551794e8-4913-5f1e-9a39-be196c30d206","task_key":"default--validation--32030","task_revision_id":"1","upstream_id":"32030","short_description":"HellaSwag validation 32030","config":"default","split":"validation","body":"{\"activity_label\":\"Education and Communications\",\"ctx\":\"[header] How to buy a carbon offset [title] Research how carbon offsets work. [step] When you buy a carbon offset, your money goes to support a project happening somewhere else in the world that reduce carbon dioxide emissions. Tree planting and soil management projects actively remove carbon dioxide from the atmosphere, while energy efficiency projects, such as wind and solar farms, reduce overall emissions.\",\"endings\":\"['Learning more at these levels will help you learn how these outputs work. [substeps] For local companies, observe them in the same way you observe a computer.', '[substeps] Other environmental environments may be contributing to how the buildings are affected by carbon emissions. Learning about fertilizer use gives you a much better idea of how energy emissions are produced and how they effect trees, livestock, and people.', '[substeps] Projects are undertaken all over the planet, so you have your choice of projects to support with your carbon offset dollars. Choose a project based on your own personal interests.', \\\"[title] Plant carbon offsets if you want to get started. [step] In their most basic forms, carbon emissions are planted so that they aren't seeded during the season.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}