{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ebac05fa-c4c4-5a3c-bd81-19a1301c5b80","task_key":"default--test--3474","task_revision_id":"1","upstream_id":"3474","short_description":"Describe the various land biomes that are usually encounteredby a traveler going…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Tropical rain forests, mangrove swamps, coral reefs, and polar ice caps', 'Tropical rain forests, temperate grasslands, and polar ice caps only', 'Tropical rain forests, tundra, and desert regions', 'Tropical rain forests, savannas, deserts, mediterranean shrublands, temperate grasslands, and arctic tundra', 'Savannahs, deserts, temperate broadleaf forests, chaparral, and alpine biomes', 'Grassland biomes, boreal forests, and sclerophylous bushlands', 'Temperate deciduous forests, tropical rain forests, and tundra', 'Tropical rain forests, montane forests, temperate coniferous forests, and permanent ice fields', 'Tropical rain forests, desert regions, temperate deciduous forests, and arctic tundra', 'The various land biomes encountered from the equator to the arctic polar ice cap are tropical rain forests, grassland biomes, temperate deciduous forests, the boreal forest or taiga, the tundra, desert regions, and sclerophylous bushlands.']\",\"question\":\"Describe the various land biomes that are usually encounteredby a traveler going from the equator to the arcticpolar ice cap.\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}