{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"30926232-ef3a-58ce-a399-bbcf8f5ff0cb","task_key":"default--test--4784","task_revision_id":"1","upstream_id":"4784","short_description":"What was concluded in a recent study comparing the genomes of modern people with…","config":"default","split":"test","body":"{\"category\":\"history\",\"options\":\"['All Native Americans, both ancient and modern, are derived from a single migration of Austral-Melanesians into the Americas by about 13,000 years ago.', 'Native Americans in North and South America have no genetic connection to their ancestors in the far north.', 'The separation between native Siberians and the earliest Native Americans occurred sometime between 20,000 and 23,000 years ago.', 'The separation between native Siberians and the earliest Native Americans occurred sometime between 30,000 and 33,000 years ago.', 'All Native Americans, both ancient and modern, are derived from a single migration of the Inuit, who arrived in the Americas by about 13,000 years ago.', 'Native Americans in South America diverged genetically from their ancestors in North America around 30,000 years ago.', 'The separation between native Siberians and the earliest Native Americans occurred around 10,000 years ago.', 'All Native Americans, both ancient and modern, are derived from multiple migrations of different Asian ethnic groups into the Americas.', 'Native Americans in North America and South America genetically diverged from each other and their ancestors in the far north by about 30,000 years ago.', 'The genomes of modern Native Americans show no significant differences from those of ancient skeletal remains.']\",\"question\":\"What was concluded in a recent study comparing the genomes of modern people with ancient skeletal remains in North and South America?\",\"src\":\"ori_mmlu-prehistory\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}