{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cd633b37-ca74-58df-9f14-1f057648c9c1","task_key":"default--test--2424","task_revision_id":"1","upstream_id":"2424","short_description":"Describe Spitz's (1945) study of sensory deprivation in a socialsetting. What do…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Social deprivation has no significant impact on emotional growth', 'Sensory and social deprivation enhance development', 'Sensory deprivation can improve problem-solving abilities', \\\"Spitz's study suggests that social deprivation can lead to accelerated cognitive development\\\", 'Sensory and social deprivation only affect physical growth', 'Sensory and social deprivation only affect language development', 'Sensory deprivation is beneficial for short periods', 'Sensory deprivation has no effect on development', 'Sensory and social deprivation can adversely affect normal development', 'Sensory and social deprivation lead to improved social skills later in life']\",\"question\":\"Describe Spitz's (1945) study of sensory deprivation in a socialsetting. What do his findingssuggest ?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}