{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c32c09ab-fbc1-53f0-a69d-24744ad03d88","task_key":"default--test--2926","task_revision_id":"1","upstream_id":"2926","short_description":"Stomata allow gases, such as H2O and CO2, to exchange between the inside of a…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['CO2 diffuses out of the leaf faster than H2O enters.', 'H2O and CO2 both diffuse out of the leaf at the same rate.', 'H2O exchanges with CO2 at equal rates.', 'CO2 diffuses out of the leaf slower than H2O enters.', 'H2O and CO2 do not exchange at all.', 'CO2 diffuses into the leaf faster than H2O exits.', 'There is no gas exchange under normal daytime conditions.', 'H2O diffuses out of the leaf slower than CO2 enters.', 'H2O diffuses out of the leaf faster than CO2 enters.', 'H2O diffuses into the leaf faster than CO2 exits.']\",\"question\":\"Stomata allow gases, such as H2O and CO2, to exchange between the inside of a plant leaf and the surrounding environment. Which of the following occurs under normal daytime environmental conditions?\",\"src\":\"ori_mmlu-high_school_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}