{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4f8808a3-1b97-5062-a5c5-fe435074365c","task_key":"default--test--2110","task_revision_id":"1","upstream_id":"2110","short_description":"Discuss the anxiety disorders listed in DSM-III.","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Three subtypes of anxiety disorders are listed in DSM-III', 'Five subtypes of dissociative disorders are listed in DSM-III', 'Six subtypes of depression disorders are listed in DSM-III', 'Eight subtypes of somatoform disorders are listed in DSM-III', 'Seven subtypes of eating disorders are listed in DSM-III', 'Two subtypes of anxiety disorders are listed in DSM-III: (1) Panic disorder, (2) generalized anxiety disorder', 'Six subtypes of anxiety disorders are listed in DSM-III, including (6) stress disorder', 'Four subtypes of personality disorders are listed in DSM-III', 'Four subtypes of anxiety disorders are listed in DSM-III, excluding atypical anxiety disorder', 'Five subtypes of anxiety disorders are listed in DSM-III: (1) Panic disorder, (2) generalized anxiety disorder, (3) phobic disorder, (4)obsessive-compulsivedisorder, and (5) atypical anxiety disorder.']\",\"question\":\"Discuss the anxiety disorders listed in DSM-III.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}