{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cc1b4b02-388d-52f2-aa5c-5d3731d9b8d7","task_key":"default--test--2948","task_revision_id":"1","upstream_id":"2948","short_description":"What is differential reproduction? What factors bring about differential…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Differential reproduction is the result of equal survival rates for all genotypes within a population', 'Differential reproduction is driven exclusively by the presence of predators in an ecosystem', 'Differential reproduction occurs when certain traits prevent any mating from happening', 'Differential reproduction is when genetic mutations are the only factor influencing which offspring survive', 'Differential reproduction is purely based on random mating', 'Differential reproduction is determined solely by the environmental temperature during breeding seasons', 'Differential reproduction is related to the physical strength of the species', 'Differential reproduction is when all offsprings have the same genotype', 'Differential reproduction occurs when the percentage of viable offspring carrying a certain genotype cannot be accounted for by purely random mating. It results from nonrandom mating, differential fecundity, or differences in zygote viability or offspring fertility.', 'Differential reproduction occurs when all offspring inherit traits randomly, regardless of parental genotypes']\",\"question\":\"What is differential reproduction? What factors bring about differential reproduction?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}