{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8b563fc7-5a57-5041-887c-ebbc25be96b7","task_key":"default--test--3501","task_revision_id":"1","upstream_id":"3501","short_description":"What is implied by the theory ofuniformitarianism?","config":"default","split":"test","body":"{\"category\":\"biology\",\"options\":\"['Uniformitarianism indicates that human activity is the primary driver of geological change.', 'Uniformitarianism posits that the earth is static and unchanging over time.', 'Uniformitarianism implies rapid geological changes.', 'Uniformitarianism suggests that the same geological processes observed today did not operate in the past.', 'Uniformitarianism infers that geological processes occur exclusively during catastrophic events.', \\\"Uniformitarianism asserts that the earth's geological features were formed in a single, divine creation event.\\\", 'Uniformitarianism implies that animals and plants continually undergo a process of organic evolution and that the earth must be much older than a few thousand years.', 'Uniformitarianism assumes that the rate of geological change is unpredictable and chaotic.', 'Uniformitarianism states that geological forces have changed over time.', 'Uniformitarianism suggests the earth is only a few thousand years old.']\",\"question\":\"What is implied by the theory ofuniformitarianism?\",\"src\":\"stemez-Biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}