{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ab68ea2d-2dc8-5e82-9eda-8c5523f1109b","task_key":"all--test--ab68ea2d-2dc8-5e82-9eda-8c5523f1109b","task_revision_id":"1","upstream_id":"","short_description":"This question refers to the following information.","config":"all","split":"test","body":"{\"choices\":\"['In the 1990s, anti-government sentiment, in response to excessive uses of federal power to resolve domestic conflicts, inspired militia groups and lone vigilantes, such as Timothy McVeigh.', 'In 1993 Attorney General Janet Reno launched an offensive against the Branch Davidian cult led by Timothy McVeigh, later drawing criticism from Congress for her heavy-handed approach.', 'Fearing a rise in anti-government sentiment after the Oklahoma City bombing, Attorney General Janet Reno sent troops to quell the Branch Davidian Cult Standoff, and later faced congressional criticism.', 'Attorney General Janet Reno resigned from office in part due to Congressional pressure put on President Clinton by Representative John Conyers.']\",\"question\":\"This question refers to the following information.\\n\\\"Americans have more freedom and broader rights than citizens of almost any other nation in the world, including the capacity to criticize their government and their elected officials. But we do not have the right to resort to violence—or the threat of violence—when we don't get our way. Our founders constructed a system of government so that reason could prevail over fear. Oklahoma City proved once again that without the law there is no freedom. Criticism is part of the lifeblood of democracy. No one is right all the time. But we should remember that there is a big difference between criticizing a policy or a politician and demonizing the government that guarantees our freedoms and the public servants who enforce our laws.\\\"\\nPresident Bill Clinton, \\\"What We Learned in Oklahoma City,\\\" 2010\\n(Written on the 15th anniversary of the Oklahoma City bombing)\\n\\\"If there would not have been a Waco, I would have put down roots somewhere and not been so unsettled with the fact that my government…was a threat to me. Everything that Waco implies was on the forefront of my thoughts. That sort of guided my path for the next couple of years.\\\"\\nTimothy McVeigh, Oklahoma City bomber, 2001\\nU.S. Representative John Conyers, Events Surrounding the Branch Davidian Cult Standoff in Waco, Texas: Hearing Before the Committee on the Judiciary, House of Representatives, 1993\\nThe above excerpts most closely support which of the following inferences?\",\"subject\":\"high_school_us_history\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}