{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"baa24bd0-ebef-58fc-8107-380e542eb83a","task_key":"default--test--3102","task_revision_id":"1","upstream_id":"3102","short_description":"In attempting to map out the climatic conditions of the biosphere, would a…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Vegetation-formation mapping is unrelated to climatic mapping', 'Climatic mapping is based exclusively on atmospheric studies without regard to vegetation', 'Vegetation-formation mapping does provide a basis for climatic mapping', 'Vegetation-formation mapping is only useful for soil studies, not climatic mapping', 'Climatologists use only temperature and precipitation data, ignoring vegetation formations', 'Climatic conditions are solely determined by geological formations, not vegetation', 'Climatic conditions do not affect vegetation formations', 'Climatologists do not need to use vegetation maps', 'Vegetation maps are too imprecise to contribute to climatic studies', \\\"Ecologists' maps focus on animal populations, which do not provide information for climatic conditions\\\"]\",\"question\":\"In attempting to map out the climatic conditions of the biosphere, would a climatologist find it helpful to correspond withan ecologist who has mapped the vegetation formations orbiomes of the biosphere?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}