{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4c824a87-e0ae-5777-ab39-c188608c9cfb","task_key":"all--test--4c824a87-e0ae-5777-ab39-c188608c9cfb","task_revision_id":"1","upstream_id":"","short_description":"The ethics of conducting archaeological research on sites with human remains of…","config":"all","split":"test","body":"{\"choices\":\"['both non-indigenous archaeologists and Native Americans are allowed onto the site at the same time.', 'there are no Native Americans who have been trained as archaeologists and no archaeologists who are Native American.', 'neither archaeologists nor Native Americans can agree on the exact location of burials at the site.', 'burials are so ancient that establishing historical or genealogical connections with modern, living groups of people is impossible.']\",\"question\":\"The ethics of conducting archaeological research on sites with human remains of indigenous North American ancestors is addressed by the Native American Graves Protection and Repatriation Act. Problems often arise when:\",\"subject\":\"prehistory\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}