{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"14d719be-c461-586e-9095-d21fc82a5afa","task_key":"default--test--3505","task_revision_id":"1","upstream_id":"3505","short_description":"How can you determine whether or not a given populationis ingenetic equilibrium?","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Measure the physical characteristics of the population', 'Compare the population to a different species', \\\"Compare the population's disease resistance to other populations\\\", 'Check for the presence of natural selection', 'Compare gene frequencies and genotype frequencies over two generations', \\\"Analyze the population's fossil record\\\", 'Observe the mating behaviors within the population for one generation', \\\"Examine the population's age distribution and life expectancy rates\\\", \\\"Monitor changes in the population's climate and environment\\\", \\\"Study the population's migration patterns\\\"]\",\"question\":\"How can you determine whether or not a given populationis ingenetic equilibrium?\",\"src\":\"stemez-Genetics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}