{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"aabb4968-86f1-50f2-bdcf-7de9ab77aefd","task_key":"default--test--3355","task_revision_id":"1","upstream_id":"3355","short_description":"Assume there is an organism in which there are five contrasting independent gene…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['1/1024, 1/1024, 1023/1,024', '1/16, 3/16, 729/1,024', '1/4, 1/4, 512/1,024', '1/8, 1/8, 121/1,024', '1/32, 1/32, 243/1,024', '1/16, 1/16, 81/1,024', '1/64, 1/4, 342/1,024', '1/2, 1/2, 1/1,024', '1/32, 1/64, 255/1,024', '1/4, 1/8, 961/1,024']\",\"question\":\"Assume there is an organism in which there are five contrasting independent gene pairs, A vs. a, B vs. b, D vs. d, E vs. e and F vs. f, for which the organism is heterozygous. If the organism were able to undergo self-fertilization, (a) what is the probability that the first progeny will have a genotype identical to that of the parent? (b) what proportion of the total progeny will be homozygous? (c) assuming complete dominance for each gene pair, what proportion of the total progeny will phenotypically exhibit the dominant form for the five characters?\",\"src\":\"stemez-Genetics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}