{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7806e5bf-da5f-5a82-86db-22e45c6f6cb2","task_key":"default--test--2317","task_revision_id":"1","upstream_id":"2317","short_description":"What are some of the characteristics of cross-cultural tests ? Name four…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Wechsler Intelligence Scale for Children, Stanford-Binet Intelligence Scales, Kaufman Brief Intelligence Test, Naglieri Nonverbal Ability Test', 'Leiter International Performance Scale, Culture Fair Intelligence Test, Progressive Matrices, Goodenough Draw-a-Man Test', 'Myers-Briggs Type Indicator, Big Five Personality Test, Emotional Intelligence Appraisal, Strengths and Difficulties Questionnaire', \\\"Peabody Picture Vocabulary Test, Wechsler Adult Intelligence Scale, Raven's Progressive Matrices, Differential Ability Scales\\\", 'California Psychological Inventory, 16 Personality Factor Questionnaire, Eysenck Personality Questionnaire, NEO Personality Inventory', 'Miller Analogies Test, Woodcock-Johnson Tests of Cognitive Abilities, Stanford Achievement Test, Kaufman Assessment Battery for Children', \\\"Torrance Tests of Creative Thinking, Bender Visual Motor Gestalt Test, Conners' Rating Scales, Achenbach System of Empirically Based Assessment\\\", 'Minnesota Multiphasic Personality Inventory, Beck Depression Inventory, Thematic Apperception Test, Rorschach Inkblot Test', \\\"Piers-Harris Children's Self-Concept Scale, Self-Directed Search, Strong Interest Inventory, Career Assessment Inventory\\\", 'Vineland Adaptive Behavior Scales, Bayley Scales of Infant Development, Denver Developmental Screening Test, Ages and Stages Questionnaires']\",\"question\":\"What are some of the characteristics of cross-cultural tests ? Name four examples of popularly administered cross-cultural tests.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}