{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bf98d35e-dea1-5000-b8e4-2ce5e9895490","task_key":"default--test--9049","task_revision_id":"1","upstream_id":"9049","short_description":"How does the greenhouse effect work?","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['Ozone absorbs infrared light from the Sun and then re-emits it, heating the atmosphere and the surface.', 'Greenhouse gases absorb ultraviolet light from the Sun which then heats the atmosphere and the surface.', 'Ozone transmits visible light allowing it to heat the surface but then absorbs most of the infrared heat trapping the heat near the surface.', 'Greenhouse gases absorb visible light and prevent it from heating the surface, but allow infrared light from Earth to escape into space.', 'Greenhouse gases absorb X-rays and ultraviolet light from the Sun which then heat the atmosphere and the surface.', 'Greenhouse gases transmit visible light allowing it to heat the surface but then absorb infrared light from Earth trapping the heat near the surface.', 'Ozone absorbs visible light, preventing it from heating the surface and then emits infrared heat into space.', 'Greenhouse gases absorb infrared light from the Sun which then heats the atmosphere and the surface.', 'Greenhouse gases absorb all light from the Sun, causing the atmosphere and the surface to heat up.', 'Ozone transmits visible light allowing it to heat the surface but then emits most of the infrared heat into space.']\",\"question\":\"How does the greenhouse effect work?\",\"src\":\"ori_mmlu-astronomy\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}