{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3c08de05-4bc8-5523-bffb-b881a127dadc","task_key":"default--test--3021","task_revision_id":"1","upstream_id":"3021","short_description":"How can you determine whether or not a given population is in genetic…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Compare gene frequencies and genotype frequencies of two generations.', \\\"Evaluate the population's response to environmental stress\\\", \\\"Assess the mutation rates of the population's genes\\\", 'Compare the population size over generations', 'Calculate the ratio of males to females in the population', 'Check the physical traits of the population', 'Monitor the birth and death rates within the population', 'Measure the migration rates in and out of the population', \\\"Examine the species diversity within the population's ecosystem\\\", 'Analyze the age distribution of the population']\",\"question\":\"How can you determine whether or not a given population is in genetic equilibrium?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}