{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"785187de-aafd-510e-8a57-af756b005ea5","task_key":"default--test--2802","task_revision_id":"1","upstream_id":"2802","short_description":"What is meant by psychosomatic disorders and what are the generalmeans used for…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Psychosomatic disorders are a type of mental illness with no physical symptoms, treated through counseling alone', 'Psychosomatic disorders are caused exclusively by environmental factors and are treated with lifestyle changes', 'Psychosomatic disorders are purely physical illnesses', 'Psychosomatic disorders are imaginary diseases', 'Psychosomatic disorders are diagnosed only through physical examinations, and are treated with surgical procedures', 'Psychosomatic disorders are genetic disorders, treated with gene therapy', \\\"A psychosomatic disorder is one in which an individual's psychological problems are a major factor in an organic pathology. The treatment is both medical and psychological.\\\", 'Psychosomatic disorders result from spiritual imbalances and are treated with spiritual healing practices', 'Psychosomatic disorders are cured only by medication', 'Psychosomatic disorders are conditions where symptoms are caused by nutritional deficiencies, treated with dietary supplements']\",\"question\":\"What is meant by psychosomatic disorders and what are the generalmeans used for treating them?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}