{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0ba771bc-07ad-598b-afea-b4837c765bd8","task_key":"default--test--2313","task_revision_id":"1","upstream_id":"2313","short_description":"Define maturation. Describe in what way maturation is the basis for much of…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Maturation is the process of acquiring knowledge through education and experience.', 'Maturation refers to the deliberate modifications to behavior based on cultural norms.', 'Maturation is the process of reaching physical peak performance.', 'Maturation is the process of adapting to the environment', 'Maturation refers to the development of bodily processes and the changes in behavior that result from such development.', 'Maturation is the natural growth of intellectual abilities without the influence of learning.', 'Maturation refers to the aging process', 'Maturation is the process of learning new skills', \\\"Maturation refers to the changes in an individual's personality over time due to personal choices.\\\", \\\"Maturation is the gradual increase in social influence on an individual's behavior.\\\"]\",\"question\":\"Define maturation. Describe in what way maturation is the basis for much of human behavior.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}