{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e5e5d699-2c66-5630-a320-e07b47995c90","task_key":"default--test--2369","task_revision_id":"1","upstream_id":"2369","short_description":"Can intelligence tests be used for diagnosing psychopathology ?","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['Intelligence test scores can be used for diagnosing psychopathology.', 'Intelligence test scores are primarily used to assess cognitive ability and do not relate to psychopathological conditions.', 'Intelligence test scores provide definitive evidence of the absence of psychopathology.', 'Intelligence tests can diagnose psychopathology when combined with genetic testing.', 'Psychopathology can be inferred from intelligence test scores with the help of behavioral analysis.', 'Intelligence test scores can determine the type of psychopathology.', 'It has not proven possible to make psychiatric diagnoses on the basis of intelligence test scores.', 'Intelligence test scores are only used for diagnosing learning disabilities, not other forms of psychopathology.', 'Intelligence test scores can accurately predict future psychopathological behavior.']\",\"question\":\"Can intelligence tests be used for diagnosing psychopathology ?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}