{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a70c2380-b794-5c7c-9910-b888f2ad575f","task_key":"all--test--a70c2380-b794-5c7c-9910-b888f2ad575f","task_revision_id":"1","upstream_id":"","short_description":"This question refers to the following information.","config":"all","split":"test","body":"{\"choices\":\"['The rise of mercantilism gave the state a new role in promoting commercial development and the acquisition of colonies overseas.', 'European states sought direct access to gold and spices and luxury goods as a means to enhance personal wealth and state power.', 'Individual captains sought great glory and wealth.', 'Christianity served as a stimulus for exploration as governments and religious authorities sought to spread the faith and counter Islam, and as a justification for the physical and cultural subjugation of indigenous civilizations.']\",\"question\":\"This question refers to the following information.\\nRead the following letter.\\nIt happened . . . that a Spaniard saw an Indian . . . eating a piece of flesh taken from the body of an Indian who had been killed. . . . I had the culprit burned, explaining that the cause was his having killed that Indian and eaten him[,] which was prohibited by Your Majesty, and by me in Your Royal name. I further made the chief understand that all the people . . . must abstain from this custom. . . . I came . . . to protect their lives as well as their property, and to teach them that they were to adore but one God[,] . . . that they must turn from their idols, and the rites they had practiced until then, for these were lies and deceptions which the devil . . . had invented. . . . I, likewise, had come to teach them that Your Majesty, by the will of Divine Providence, rules the universe, and that they also must submit themselves to the imperial yoke, and do all that we who are Your Majesty's ministers here might order them.\\n—Hernan Cortez, Fifth Letter to Holy Roman Emperor Charles V, 1521\\nWhich of the following motivations for exploration is most evident from the document above?\",\"subject\":\"high_school_european_history\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}