{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d88a0ff9-3099-5916-aa2f-2136694d150b","task_key":"default--test--3280","task_revision_id":"1","upstream_id":"3280","short_description":"Mesogleaand mesoderm are two terms used to describe the middle tissue layer of…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Mesoglea is the middle tissue layer in all invertebrates, and mesoderm is the equivalent in vertebrates.', 'Mesoglea is found in insects and all vertebrate groups, while mesoderm is found in Coelenterates', 'Mesoderm is the outer layer of cells, while mesoglea is the inner layer', 'Mesoglea is the primary tissue layer in fungi, while mesoderm is the connective tissue in higher plants.', 'Mesoderm is found only in aquatic organisms, while mesoglea is present in terrestrial animals.', 'Mesoglea is a type of mesoderm found exclusively in mammals.', 'Mesoglea is the middle embryonic tissue layer found in all animal groups, while mesoderm is a specialized layer in plants.', 'Mesoglea is the layer between the outer epidermis and the inner layer of cells lining the gastrovascular cavity found in Coelenterates, while mesoderm is the middle embryonic tissue layer found in higher invertebrates, insects, and all vertebrate groups.', 'Mesoglea and mesoderm are the same thing', 'Mesoderm is a gelatinous layer found in jellyfish, while mesoglea is a solid tissue layer in birds and reptiles.']\",\"question\":\"Mesogleaand mesoderm are two terms used to describe the middle tissue layer of an organism. What distinction can be made between the two and in what organisms can each be found?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}