{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bbfbff7d-7ab2-58b3-a903-74f675a841e4","task_key":"all--test--bbfbff7d-7ab2-58b3-a903-74f675a841e4","task_revision_id":"1","upstream_id":"","short_description":"This question refers to the following information.","config":"all","split":"test","body":"{\"choices\":\"['The economic policies of his predecessor Warren G. Harding', 'The growing strength of radical politics in America following the Russian Revolution', 'Populist agitation in the West', 'The governmental policies of the Progressive Era']\",\"question\":\"This question refers to the following information.\\nOne of the rights which the freeman has always guarded with most jealous care is that of enjoying the rewards of his own industry. Realizing that the power to tax is the power to destroy and that the power to take a certain amount of property or of income is only another way of saying that for a certain proportion of his time a citizen must work for the government, the authority to impose a tax on the people has been most carefully guarded.… A government which lays taxes on the people not required by urgent necessity and sound public policy is not a protector of liberty, but an instrument of tyranny. It condemns the citizen to tyranny. One of the first signs of the breaking down of free government is a disregard by the taxing power of the right of the people to their own property.… Unless the people can enjoy that reasonable security in the possession of their property, which is guaranteed by the Constitution, against unreasonable taxation, freedom is at an end.… With us economy is imperative. It is a full test of our national character.… It is always the people who toil that pay.\\n—Calvin Coolidge, \\\"Economy in the Interest of All,\\\" June 30, 1924\\nIn the passage above Coolidge is reacting against which of the following?\",\"subject\":\"high_school_us_history\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}