{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a5845750-2b64-5f3b-97c4-6e89523aab80","task_key":"all--test--a5845750-2b64-5f3b-97c4-6e89523aab80","task_revision_id":"1","upstream_id":"","short_description":"This question refers to the following information.","config":"all","split":"test","body":"{\"choices\":\"[\\\"Metternich's statement about the military despotism of Bonaparte led to the elimination of all empires in Europe.\\\", \\\"Metternich's statement about fulfilling duties indicated his support for the Holy Alliance that controlled the fate of Europe.\\\", \\\"Metternich's statement about the unity of monarchs alludes to the creation of the Concert of Europe.\\\", \\\"Metternich's disgust for secret societies led to the creation of the Carlsbad Decrees.\\\"]\",\"question\":\"This question refers to the following information.\\nRead the following excerpt.\\nThe revolutionary seed had penetrated into every country and spread more or less. It was greatly developed under the régime of the military despotism of Bonaparte. His conquests displaced a number of laws, institutions, and customs; broke through bonds sacred among all nations, strong enough to resist time itself; which is more than can be said of certain benefits conferred by these innovators.\\nThe monarchs will fulfil the duties imposed upon them by Him who, by entrusting them with power, has charged them to watch over the maintenance of justice, and the rights of all, to avoid the paths of error, and tread firmly in the way of truth. Placed beyond the passions which agitate society, it is in days of trial chiefly that they are called upon to despoil realities of their false appearances, and to show themselves as they are, fathers invested with the authority belonging by right to the heads of families, to prove that, in days of mourning, they know how to be just, wise, and therefore strong, and that they will not abandon the people whom they ought to govern to be the sport of factions, to error and its consequences, which must involve the loss of society.\\nUnion between the monarchs is the basis of the policy which must now be followed to save society from total ruin. . . .\\nLet them not confound concessions made to parties with the good they ought to do for their people, in modifying, according to their recognized needs, such branches of the administration as require it.\\nLet them be just, but strong; beneficent, but strict.\\nLet them maintain religious principles in all their purity, and not allow the faith to be attacked and morality interpreted according to the social contract or the visions of foolish sectarians.\\nLet them suppress Secret Societies; that gangrene of society.\\n—Klemens von Metternich, Political Confession of Faith, 1820\\nThe final result of the negotiations led by Metternich during the Congress of Vienna is being referenced in the document above in which of the following ways?\",\"subject\":\"high_school_european_history\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}