{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4276ed05-f925-5a56-b5fd-8c6e999ee245","task_key":"default--test--3272","task_revision_id":"1","upstream_id":"3272","short_description":"Hybrids between some related species of plants are sterile because the parent…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['The descendants would have a reduced lifespan due to the increased chromosome number.', 'The descendants would have a higher rate of mutation due to the increased chromosome number.', 'The descendants would have a decreased ability to reproduce due to chromosomal abnormalities.', 'The descendants would be genetically identical to the parent plant.', 'The descendants would be at a selective advantage because of the increased ability to introgress.', 'The plant with the double chromosome number would be more susceptible to disease, impacting the survival of its descendants.', 'The plant with the double chromosome number would be genetically defective and have no descendants.', 'The descendants would be reproductively successful because they could backcross with the parental species.', 'The descendants would be reproductively isolated because of the increased chromosome number.', 'The descendants would regain the ability to reproduce sexually because chromosomes could pair normally.']\",\"question\":\"Hybrids between some related species of plants are sterile because the parent plants had different chromosome numbers. Occasionally the chromosome number of such a hybrid plant doubles spontaneously. Which of the following best describes the descendants of those plants with the double chromosome number?\",\"src\":\"ori_mmlu-college_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}