{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bb4e9eb4-2f46-53ac-ba63-d03ea3328c03","task_key":"default--test--3260","task_revision_id":"1","upstream_id":"3260","short_description":"What are the results of fertilization?","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Creation of new cells', 'Initiation of meiosis in the zygote', 'Production of energy', 'Immediate growth of the embryo into a fetus', 'Formation of identical twin offspring every time', 'Restoration of diploid state, initiation of zygote cleavage, sex determination, and species variation', 'Decrease in genetic diversity of the species', 'Duplication of parental DNA without variation', 'Initiation of mitosis', 'Conversion of somatic cells into germ cells']\",\"question\":\"What are the results of fertilization?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}