{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"84cabb99-482e-5bdd-8def-b4b443f19cfb","task_key":"default--test--2976","task_revision_id":"1","upstream_id":"2976","short_description":"What are the results of fertilization?","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['DNA replication, cell division, energy production, and protein synthesis', 'Photosynthesis, respiration, transpiration, and nutrient absorption', 'Synthesis of hormones, enzymatic reactions, metabolic activity, and homeostasis', 'Evolution, mutation, adaptation, and natural selection', 'Formation of a diploid cell, development of multicellular organism, growth, and aging', 'Fusion of two haploid sex cells, initiation of cleavage, sex determination, and rendering of species variation', 'Metamorphosis, regeneration, asexual reproduction, and tissue differentiation', 'Cellular specialization, organ system formation, maturation, and senescence', 'Creation of identical genetic copies, cloning, genetic modification, and hybridization', 'Activation of immune response, antibody production, pathogen resistance, and disease elimination']\",\"question\":\"What are the results of fertilization?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}