{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d1e16c2c-5567-5cc1-b55b-db1af0ab0d7a","task_key":"default--test--2477","task_revision_id":"1","upstream_id":"2477","short_description":"Discuss the different types of dissociative disorders listed in DSM-III.","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['(1) insomnia disorder, (2) hypersomnolence disorder, (3) narcolepsy, (4) breathing-related sleep disorders, (5) circadian rhythm sleep-wake disorders', '(1) depression, (2) anxiety, (3) bipolar disorder, (4) schizophrenia, (5) PTSD', '(1) anorexia nervosa, (2) bulimia nervosa, (3) binge eating disorder, (4) pica, (5) rumination disorder', '(1) obsessive-compulsive disorder, (2) body dysmorphic disorder, (3) trichotillomania, (4) hoarding disorder, (5) excoriation disorder', '(1) somatization disorder, (2) conversion disorder, (3) pain disorder, (4) hypochondriasis, (5) body dysmorphic disorder', '(1) general adaptation syndrome, (2) learned helplessness, (3) reactive attachment disorder, (4) disinhibited social engagement disorder, (5) adjustment disorders', '(1) gender dysphoria, (2) sexual dysfunctions, (3) paraphilic disorders, (4) other specified sexual disorder, (5) unspecified sexual disorder', '(1) major depressive disorder, (2) dysthymia, (3) cyclothymia, (4) premenstrual dysphoric disorder, (5) disruptive mood dysregulation disorder', 'Five categories of dissociative disorders are listed in DSM-III: (1) psychogenic amnesia, (2) psychogenic fugue, (3) multiple personality, (4) depersonalization disorder, and (5) other dissociative disorders', '(1) hallucinations, (2) delusions, (3) paranoia, (4) neurosis, (5) psychosis']\",\"question\":\"Discuss the different types of dissociative disorders listed in DSM-III.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}