{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0a5295c1-ec09-52c3-b295-a5f5f2db8d6e","task_key":"default--test--3479","task_revision_id":"1","upstream_id":"3479","short_description":"What are the results of fertilization?","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Creation of multiple cells, apoptosis, gene silencing, and evolutionary adaptation', 'Fusion of diploid cells, onset of embryonic development, gender differentiation, and genetic stabilization', 'Formation of a diploid cell, mitosis, meiosis, and genetic diversity', 'Replication of somatic cells, induction of pluripotency, chromosome pairing, and alteration of genetic code', 'Fusion of haploid sex cells, initiation of zygote cleavage, sex determination, and species variation', 'Cell division, gene expression, DNA replication, and genetic variation', 'Synthesis of new proteins, activation of growth factors, chromosomal crossing-over, and phenotype establishment', 'Formation of a haploid cell, cytokinesis, tissue differentiation, and mutation introduction', 'Cell differentiation, organogenesis, morphogenesis, and genetic recombination', 'Combination of genetic material, activation of embryonic genes, cellular specialization, and creation of genetic clones']\",\"question\":\"What are the results of fertilization?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}