{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f5c57c14-e0f2-538b-a298-f57e81eda298","task_key":"default--test--2032","task_revision_id":"1","upstream_id":"2032","short_description":"Arnold Gesell is significant to the history of school psychology because he","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['developed the first standardized test for elementary school children', 'introduced the concept of emotional intelligence in education', 'created a widely used classification system for learning disabilities', 'developed a version of the thematic apperception test appropriate for use with children', 'identified the four major periods of cognitive development', 'advocated for the inclusion of special needs students in mainstream classrooms', 'established the ethical standards of the National Association of School Psychologists', 'pioneered the use of psychoanalysis in school settings', 'devised a prototypical normative assessment for infants and young children', 'established the first school psychology graduate program']\",\"question\":\"Arnold Gesell is significant to the history of school psychology because he\",\"src\":\"ori_mmlu-high_school_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}