{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8224c921-31ac-5e4b-a799-4858d6464820","task_key":"default--test--2251","task_revision_id":"1","upstream_id":"2251","short_description":"Discuss cognitive development during adolescence as describedby Piaget.","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['The stage of formal operations begins at about the age of 11 when the child begins to think abstractly, hypothetically, and idealistically.', 'Cognitive development peaks in early adolescence and declines thereafter.', 'Cognitive development during adolescence is marked by a return to sensory-motor thinking.', 'Cognitive development begins in adolescence.', 'Cognitive development ends with the stage of formal operations.', 'Adolescents revert to egocentric thinking patterns that are typical of early childhood.', 'The stage of formal operations is only reached by a minority of individuals, with most never advancing beyond concrete operations.', 'The stage of formal operations is achieved by all individuals by the age of 8.', 'Cognitive development is characterized by the ability to deal with concrete situations.', 'Adolescents primarily focus on developing practical skills rather than abstract thinking.']\",\"question\":\"Discuss cognitive development during adolescence as describedby Piaget.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}