{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9a06cdc8-2827-50ab-b3d3-45420848ed1a","task_key":"all--test--9a06cdc8-2827-50ab-b3d3-45420848ed1a","task_revision_id":"1","upstream_id":"","short_description":"This question refers to the following information.","config":"all","split":"test","body":"{\"choices\":\"['Luddites', 'Liberals', 'Benthamites', 'Chartists']\",\"question\":\"This question refers to the following information.\\nRead the following excerpt.\\nIf civilized education developed in every child its natural inclinations, we should see nearly all rich children enamored of various very plebeian occupations, such as that of the mason, the carpenter, the smith, the saddler. I have instanced Louis the XVI, who loved the trade of locksmith; an Infanta of Spain preferred that of shoemaker; a certain king of Denmark gratified himself by manufacturing syringes; the former king of Naples loved to sell the fish he had caught in the market-place himself; the prince of Parma, whom Condillac had trained in metaphysical subtitles, in the understanding of intuition, of cognition, had no taste but for the occupation of church-warden and lay-brother.\\nThe great majority of wealthy children would follow these plebeian tastes, if civilized education did not oppose the development of them; and if the filthiness of the workshops and the coarseness of the workmen did not arouse a repugnance stronger than the attraction. What child of a prince is there who has no taste for one of the four occupations I have just mentioned, that of mason, carpenter, smith, saddler, and who would not advance in them if he beheld from an early age the work carried on in blight workshops, by refined people, who would always arrange a miniature workshop for children, with little implements and light labor?\\n—Charles Fourier, On Education, 1838\\nMany in Fourier's circles advocated for universal male suffrage, which was propagated most by which of the following groups?\",\"subject\":\"high_school_european_history\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}