{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cbaf835b-6479-52b1-ac6f-20d598805f5f","task_key":"default--test--3370","task_revision_id":"1","upstream_id":"3370","short_description":"Why isn't a biome map of the earth a true representationof thevegetation…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Biome maps only display the dominant vegetation type, ignoring the presence of other vegetation forms.', 'Biome maps fail to consider the impact of human activities on vegetation distribution.', 'Biome maps are often created with inaccurate data', 'Biome maps do not include aquatic vegetation', 'Biome maps represent political boundaries rather than natural vegetation formations.', 'Biome maps cannot account for the effects of seasonal changes on vegetation.', 'Biome maps are too detailed and specific, not allowing for variations within a single vegetation type.', 'Biome maps are based solely on temperature, ignoring other climatic factors that influence vegetation.', 'Real vegetation types usually grade one into another making it impossible to tell where one formation ends and another begins.', 'Biome maps are typically outdated']\",\"question\":\"Why isn't a biome map of the earth a true representationof thevegetation formations found on land?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}