{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5f407f67-eb82-5b8d-8a4b-d9845752541b","task_key":"default--test--2540","task_revision_id":"1","upstream_id":"2540","short_description":"List and define three approaches to the study of developmental psychology.","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Biological, psychoanalytic, and social learning', 'Learning, constructivist, and information processing', 'Biological, evolutionary, and cognitive', 'Contextual, evolutionary, and psychodynamic', 'Sociocultural, learning, and ecological', 'Behavioral, cognitive, and existential', 'Mechanistic, organismic, and psychoanalytic', 'Neuroscientific, psychosexual, and sociocultural', 'Cognitive, behavioral, and humanistic', 'Ecological, social, and cognitive-behavioral']\",\"question\":\"List and define three approaches to the study of developmental psychology.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}