{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"08e23e38-ff89-521d-9f99-8af869fbed4a","task_key":"default--test--2732","task_revision_id":"1","upstream_id":"2732","short_description":"Discuss the influence of the five early schools of thought on modern psychology.","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['The early schools of thought were only relevant to the cultures in which they were developed and have no bearing on modern psychology.', 'Modern psychology only recognizes the methodologies of the early schools of thought but not their theoretical contributions.', 'All early schools of thought are obsolete today.', 'Modern psychology completely rejects the principles of early schools of thought.', 'Each early school of thought had some beneficial effect on the shaping of psychology as we know it today.', 'The five early schools of thought were independently developed but did not influence modern psychology.', 'Early schools of thought have been replaced by a single, unified theory that explains all psychological phenomena.', 'Three of the early schools of thought continue to dominate psychological research and practice, while the other two have been discredited.', 'Only one school of thought influenced modern psychology.', 'Modern psychology is a direct reflection of only two early schools of thought.']\",\"question\":\"Discuss the influence of the five early schools of thought on modern psychology.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}