{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c3dcf533-788d-5785-b86c-909e905c27e6","task_key":"default--test--3040","task_revision_id":"1","upstream_id":"3040","short_description":"What problems are posed in referring to the many forms of protozoans as…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Protozoans can be classified into only two distinct groups based on mobility.', 'Protozoans all live in similar habitats, which negates the need for diverse classification.', 'Protozoans exhibit extreme diversity, taxonomic organization is problematic, and they possess certain plant-like features.', 'Protozoans are a type of bacteria, making their classification straightforward.', 'Protozoans are all the same', 'All protozoans have a similar genetic makeup, which simplifies classification.', 'Protozoans are easy to classify', 'Protozoans are multicellular organisms, which makes them easier to classify into one phylum.', \\\"The term 'protozoan' refers to a single species with little variation, thus one phylum is sufficient.\\\", 'Protozoans only possess animal-like features']\",\"question\":\"What problems are posed in referring to the many forms of protozoans as belonging to one single animal phylum?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}