{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bb513ba9-d39e-5cef-a5a5-e7f99ce3269b","task_key":"default--test--2674","task_revision_id":"1","upstream_id":"2674","short_description":"Explain the term \"psychosis\" and the distinction between functionaland organic…","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Psychosis is characterized by persistent happiness and clarity of thought', 'Psychosis is a minor mental disorder', 'Organic psychosis results from voluntary substance abuse, whereas functional psychosis is always congenital', 'Organic psychosis is typically induced by changes in the weather or climate', 'Organic psychosis is caused by psychological trauma', 'A psychosis is a severe mental disorder causing impaired thinking and emotion. Organic psychosis is caused by impaired brain functioning due to structural lesions or disease, while functional psychosis does not have any apparent pathological changes in the brain.', 'Functional psychosis is a form of psychosis that only occurs in older adults', 'Functional psychosis is caused by physical brain damage', 'Psychosis is a mild condition that improves without treatment', 'Functional psychosis is caused by infectious diseases, while organic psychosis is a result of genetic factors']\",\"question\":\"Explain the term \\\"psychosis\\\" and the distinction between functionaland organic psychoses.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}