{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9eb2e6c8-6553-5a54-84ac-b9a6594f64f0","task_key":"default--test--2124","task_revision_id":"1","upstream_id":"2124","short_description":"What is the CPI ? How is it different from the MMPI ?","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['CPI stands for Clinical Psychopathy Index, a variant of the MMPI', 'CPI is a clinical tool for diagnosing mental illnesses', 'CPI is a cognitive performance test, unlike the MMPI which assesses personality', 'The CPI is a projective test that measures subconscious traits, while the MMPI is an objective test', 'CPI is primarily used for educational testing, whereas MMPI is used in clinical psychology', 'CPI is a measure of inflation, whereas MMPI is a personality assessment', 'The California Psychological Inventory (CPI) is an objective personality inventory developed for use with less clinical less deviant groups of subjects than the MMPI.', 'CPI is used to measure gross psychopathy', 'CPI and MMPI are the same', 'CPI is a newer version of the MMPI with updated scales and norms']\",\"question\":\"What is the CPI ? How is it different from the MMPI ?\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}