{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ffcde254-852a-5716-a295-8ef3f67c07fd","task_key":"default--test--3025","task_revision_id":"1","upstream_id":"3025","short_description":"Consider the following three loci in humans, each of which is considered to be a…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['2,400 different genotypic combinations', '10,000 different genotypic combinations', '1,728 different genotypic combinations', '3,600 different genotypic combinations', '5,000 different genotypic combinations', '192 different genotypic combinations', '9,216 different genotypic combinations', '6,000 different genotypic combinations', '7,560 different genotypic combinations', '8,640 different genotypic combinations']\",\"question\":\"Consider the following three loci in humans, each of which is considered to be a complex locus with multiple alleles: ABO locus (6 alleles),Rhlocus (8 alleles) and MN locus (4 alleles). Assuming that each locus is independent of the other two, how many different genotypic combinations can there exist in a given population?\",\"src\":\"stemez-Genetics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}