{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b1e199ef-2c3d-5887-9cb1-1e38393281a1","task_key":"default--test--5979","task_revision_id":"1","upstream_id":"5979","short_description":"Which of the following is a true statement about the flow of energy in an…","config":"default","split":"test","body":"{\"category\":\"other\",\"options\":\"['Energy is evenly distributed among all organisms in an ecosystem.', 'All organisms in an ecosystem receive the same amount of energy.', 'Energy transfer between organisms normally involves conservation of heat energy.', 'Chemical energy is converted into radiant energy, which is then converted into chemical energy at the next trophic level.', 'The amount of energy transferred from one trophic level to the next is constant.', 'Energy flow between trophic levels is 100% efficient.', 'Smaller organisms need less energy per gram of body weight than do larger organisms.', 'Energy is transferred from consumers to producers.', 'Energy flow in an ecosystem is cyclical.', 'Energy flow between trophic levels is inefficient.']\",\"question\":\"Which of the following is a true statement about the flow of energy in an ecosystem?\",\"src\":\"ori_mmlu-miscellaneous\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}