{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b36d0d01-b212-5e8f-96e3-ba6f422b32f0","task_key":"default--test--2308","task_revision_id":"1","upstream_id":"2308","short_description":"What are the differences between psychotic andneurotic depressions ?","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['There is no difference between psychotic and neurotic depressions', 'Neurotic depression can lead to psychotic breaks, whereas psychotic depression cannot.', 'Psychotic depression is a milder form of depression, while neurotic depression involves more intense emotional distress.', 'Psychotic depressives respond better to psychotherapy alone, while neurotic depressives require medication.', 'Neurotic depressives often experience psychosis, whereas psychotic depressives are more prone to neurosis.', \\\"Psychotic depressives experience hallucinations while neurotic depressives don't\\\", 'Neurotic depression is more severe than psychotic depression', 'The principal qualitative difference is delusions in psychotic depressives, which are not part of the neurotic depressive syndrome. The quantitative difference is that common symptoms of depression are more severe in psychotic depressives.', 'Psychotic depressives are aware of their irrational thoughts and behaviors, unlike neurotic depressives.', 'Neurotic depression is characterized by physical symptoms, whereas psychotic depression is solely a mental disorder.']\",\"question\":\"What are the differences between psychotic andneurotic depressions ?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}