{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"03103951-c37e-59aa-8bae-2be45dbd8490","task_key":"default--test--5033","task_revision_id":"1","upstream_id":"5033","short_description":"The ethics of conducting archaeological research on sites with human remains of…","config":"default","split":"test","body":"{\"category\":\"history\",\"options\":\"['neither archaeologists nor Native Americans can agree on the exact location of burials at the site.', 'burials are so ancient that establishing historical or genealogical connections with modern, living groups of people is impossible.', 'archaeologists are not culturally sensitive to the spiritual beliefs of the Native Americans.', 'there is a lack of funding to properly conduct archaeological research.', 'there are no Native Americans who have been trained as archaeologists and no archaeologists who are Native American.', 'both non-indigenous archaeologists and Native Americans are allowed onto the site at the same time.', 'Native Americans and archaeologists have different interpretations of the artifacts found.']\",\"question\":\"The ethics of conducting archaeological research on sites with human remains of indigenous North American ancestors is addressed by the Native American Graves Protection and Repatriation Act. Problems often arise when:\",\"src\":\"ori_mmlu-prehistory\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}