{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"95c7e9b9-ea56-5d4a-ace4-d98d74674b58","task_key":"default--test--3058","task_revision_id":"1","upstream_id":"3058","short_description":"Which of the following is a benefit that mycorrhizal fungi confer to many…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['They fix nitrogen, which is particularly important for plants in nitrogen-limited habitats.', 'They provide plants with access to unlimited water resources.', 'They provide carbon to plants in exchange for fixed nitrogen.', 'They help plants create their own food through photosynthesis.', 'They enhance plant growth by releasing growth hormones.', 'They protect plant roots from desiccation in extremely dry habitats.', 'They increase plant resistance to pests and diseases.', 'They assist in the absorption of carbon dioxide from the atmosphere.', 'They provide plants with access to potassium, an element abundant in all kinds of soils.', 'They provide access to phosphorus, an essential element that is limited in many kinds of soils.']\",\"question\":\"Which of the following is a benefit that mycorrhizal fungi confer to many plants?\",\"src\":\"ori_mmlu-college_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}