{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5424c93c-4387-5f76-872f-67009c4efce2","task_key":"default--test--2468","task_revision_id":"1","upstream_id":"2468","short_description":"What is unique about Gordon Allport's approach to personality research?","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Allport emphasized the importance of genetic inheritance in personality development.', 'Allport proposed that personality is primarily formed through social interactions during adulthood.', 'Allport focused on the role of childhood experiences in shaping personality.', 'Allport suggested that the environment has no significant impact on personality formation.', 'Allport believed in the validity of general principles.', 'Allport introduced the hierarchy of needs as a model for understanding human motivation.', 'Allport stressed the difference between the nomothetic and the ideographic methods of study and preferred the ideographic method.', 'Allport identified the five-factor model as the definitive structure of personality traits.', 'Allport developed the concept of the collective unconscious.', 'Allport argued for the primary influence of unconscious processes in shaping personality.']\",\"question\":\"What is unique about Gordon Allport's approach to personality research?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}