{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9271800e-fc87-518e-ab6a-01aa60c48fd1","task_key":"default--test--4681","task_revision_id":"1","upstream_id":"4681","short_description":"This question refers to the following information.","config":"default","split":"test","body":"{\"category\":\"history\",\"options\":\"['African slavery was a direct result of Spanish settlements in Florida.', 'The Spanish conquest of the Americas was motivated by a desire to spread Aristotelian philosophy.', 'Due to racial prejudice, Spanish explorers shunned intermarriage with native people.', 'The Spanish conquest of the Americas was universally condemned by the Catholic Church.', 'Juan de Sepulveda was a major critic of the Spanish conquest, due to his belief in natural law.', 'Bartolomé de Las Casas supported the Spanish conquest because he believed it would improve the lives of the indigenous people.', 'Early native civilizations in Mexico introduced Spanish explorers to cattle ranching and wheat cultivation.', 'The Spanish conquest of the Americas led directly to the abolition of slavery.', 'Christopher Columbus was not the first European to have explored North America.', 'Spanish conquerors were influenced by the Native American belief in natural rights.']\",\"question\":\"This question refers to the following information.\\n\\\"Those whose condition is such that their function is the use of their bodies and nothing better can be expected of them, those, I say, are slaves of nature. It is better for them to be ruled thus.\\\"\\nJuan de Sepulveda, Politics, 1522\\n\\\"When Latin American nations gained independence in the 19th century, those two strains converged, and merged with an older, more universalist, natural law tradition. The result was a distinctively Latin American form of rights discourse. Paolo Carozza traces the roots of that discourse to a distinctive application, and extension, of Thomistic moral philosophy to the injustices of Spanish conquests in the New World. The key figure in that development seems to have been Bartolomé de Las Casas, a 16th-century Spanish bishop who condemned slavery and championed the cause of Indians on the basis of a natural right to liberty grounded in their membership in a single common humanity. 'All the peoples of the world are humans,' Las Casas wrote, and 'all the races of humankind are one.' According to Brian Tierney, Las Casas and other Spanish Dominican philosophers laid the groundwork for a doctrine of natural rights that was independent of religious revelation 'by drawing on a juridical tradition that derived natural rights and natural law from human rationality and free will, and by appealing to Aristotelian philosophy.'\\\"\\nMary Ann Glendon, \\\"The Forgotten Crucible: The Latin American Influence on the Universal Human Rights Idea,” 2003\\nWhich one of the following statements about the Spanish conquest of the Americas is most accurate?\",\"src\":\"ori_mmlu-high_school_us_history\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}