{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d174fb90-48a9-5b42-8919-953f8e1cbeb5","task_key":"default--test--3451","task_revision_id":"1","upstream_id":"3451","short_description":"Describe the various types of evidence from living organisms whichsupport the…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Evidence from historical records, archaeological findings, and fossils', 'Evidence from geography, climate, and environment', 'Evidence from astronomical observations, planetary movements, and meteorological patterns', 'Evidence from taxonomy, morphology, comparative biochemistry, embryological structures and development, and genetics.', 'Evidence from the study of pure mathematics, abstract algebra, and number theory', 'Evidence from linguistic development, written language evolution, and communication systems', 'Evidence from the use of artificial intelligence, machine learning, and computational simulations in biology', 'Evidence from dietary patterns, culinary traditions, and nutrition science', 'Evidence from social behavior, communication, and cultural practices', 'Evidence from medical advancements, pharmaceutical inventions, and healthcare practices']\",\"question\":\"Describe the various types of evidence from living organisms whichsupport the theory of evolution.\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}