{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5c1b9d94-f15c-5e4a-8063-851a2f561e5c","task_key":"all--test--5c1b9d94-f15c-5e4a-8063-851a2f561e5c","task_revision_id":"1","upstream_id":"","short_description":"This question refers to the following information.","config":"all","split":"test","body":"{\"choices\":\"['Antitrust reforms of the Progressive Era', 'Free trade policies of the 1970s', 'Increasing federal income tax rates after World War I', 'Decreasing federal income tax rates in the 1980']\",\"question\":\"This question refers to the following information.\\n\\\"Whereas it is expedient that new provisions and regulations should be established for improving the revenue of this kingdom, and for extending and securing the navigation and commerce between Great Britain and your Majesty's dominions in America, which, by the peace, have been so happily enlarged: and whereas it is just and necessary, that a revenue be raised, in your Majesty's said dominions in America, for defraying the expenses of defending, protecting, and securing the same; we, your Majesty's most dutiful and loyal subjects, the commons of Great Britain, in parliament assembled, being desirous to make some provision, in this present session of parliament, towards raising the said revenue in America, have resolved to give and grant unto your Majesty the several rates and duties herein after-mentioned….\\\"\\nThe Sugar Act of 1764\\nThe goals presented in the excerpt have the most in common with which of the following?\",\"subject\":\"high_school_us_history\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}