{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3e689a9a-e907-543a-a49a-92420cc6c1df","task_key":"default--test--2608","task_revision_id":"1","upstream_id":"2608","short_description":"Describe the role maturation plays in the \"readiness\" or potentiality for a…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"[\\\"Maturation accelerates 'readiness' for learning, making the process identical across different skills.\\\", 'Readiness for learning is not related to age.', 'Readiness for learning is entirely dependent on external environmental factors, not on maturation.', 'Maturation is a fixed process that follows the same timeline for learning all types of skills.', \\\"Maturation plays a minimal role, with 'readiness' for learning being primarily influenced by prior knowledge.\\\", \\\"Maturation underlies the 'readiness' or potentiality for learning certain skills. It is reached at a characteristic age and varies among individuals.\\\", 'Readiness for learning certain skills occurs uniformly at the same age for all individuals.', \\\"Maturation is the only factor determining 'readiness' for learning, irrespective of individual differences.\\\", \\\"Maturation has no role in 'readiness' for learning.\\\", \\\"Maturation hinders the 'readiness' for learning certain skills.\\\"]\",\"question\":\"Describe the role maturation plays in the \\\"readiness\\\" or potentiality for a certain ability.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}