{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cf6b9661-65fb-5f72-bd03-ad02cfd615cc","task_key":"default--test--5164","task_revision_id":"1","upstream_id":"5164","short_description":"During which of the following processes within the hydrologic cycle do water…","config":"default","split":"test","body":"{\"category\":\"other\",\"options\":\"['Water seeping into groundwater reservoirs', 'Absorption of rainwater by the soil', 'Formation of a cloud from water vapor', 'Formation of dew from water vapor', 'Water flow in rivers and streams', 'Formation of snow from water vapor', 'Formation of ice from water', 'Runoff along the land surface', 'Evaporation from the ocean surface', 'Formation of fog from water vapor']\",\"question\":\"During which of the following processes within the hydrologic cycle do water molecules absorb energy?\",\"src\":\"ori_mmlu-miscellaneous\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}