{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f0a1a7b0-cf17-55cf-b885-21edf4182b0e","task_key":"default--test--3131","task_revision_id":"1","upstream_id":"3131","short_description":"Explain the four important evolutionary events that occurred inthe Paleozoic…","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Emergence of the first flowering plants, the appearance of first large mammals, the rise of marine reptiles, and the appearance of amphibians', 'Emergence of the first birds, the appearance of the first fishes, the diversification of insects, and the rise of early amphibians', 'Development of the first coral reefs, the appearance of the first bony fish, the rise of the first tetrapods, and the diversification of vascular plants', 'Emergence of dinosaurs, the appearance of first mammals, the rise of first birds, and the appearance of first amphibians', 'Appearance of the first vertebrates, the emergence of the first land plants, the rise of the first air-breathing animals, and the appearance of the first reptiles', 'Emergence of first trees, the appearance of first flowers, the rise of first grasses, and the appearance of first fungi', 'Emergence of the first complex multicellular life, the appearance of the first terrestrial arthropods, the rise of the first jawed fish, and the appearance of the first land ecosystems', 'Appearance of the first amphibians, the emergence of the first insects, the colonization of land by plants, and the rise of the first seed-bearing plants', 'Appearance of the first land mammals, the emergence of the first dinosaurs, the rise of the first marine algae, and the appearance of the first sharks', 'Appearance of first humans, the emergence of first birds, the rise of first insects, and the appearance of first mammals']\",\"question\":\"Explain the four important evolutionary events that occurred inthe Paleozoic Era.\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}