{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7390ec57-1c2c-5c9a-9229-00b83fffd28c","task_key":"default--test--3525","task_revision_id":"1","upstream_id":"3525","short_description":"What are the chief characteristics of theprotozoans?","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Protozoans only exist in water habitats', 'Protozoans are almost exclusively microscopic organisms, live either singly or in colonies, usually unicellular, have subcellular structures called organelles, have reproduction process that could be asexual or sexual, and they are found in a variety of habitats.', 'Protozoans only reproduce sexually', 'Protozoans can only reproduce in the presence of a host organism.', 'Protozoans are a type of plant and perform photosynthesis.', 'Protozoans are exclusively multicellular, complex organisms with organ systems.', 'Protozoans are large, visible organisms that only reproduce by fragmentation.', 'Protozoans lack organelles and have a simple cell structure similar to prokaryotes.', 'Protozoans are multicellular organisms', 'Protozoans are only found in extreme environments like hot springs and deep-sea vents.']\",\"question\":\"What are the chief characteristics of theprotozoans?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}