{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"dbfc96ed-fe5f-5c98-aacb-323352e40c3b","task_key":"default--test--2179","task_revision_id":"1","upstream_id":"2179","short_description":"List and define the different levels of mental retardation.","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['(1) Minimal mental retardation, (2) minor mental retardation, (3) medium mental retardation, (4) major mental retardation, (5) maximal mental retardation', '(1) Profound mental retardation, (2) severe mental retardation, (3) moderate mental retardation, (4) mild mental retardation, (5) borderline mental retardation', '(1) Severe mental retardation, (2) moderate mental retardation, (3) mild mental retardation, (4) profound mental retardation, (5) intense mental retardation', '(1) Extreme mental retardation, (2) profound mental retardation, (3) severe mental retardation, (4) moderate mental retardation, (5) slight mental retardation', '(1) Profound mental retardation, (2) severe mental retardation, (3) borderline mental retardation, (4) mild mental retardation, (5) negligible mental retardation', 'The different levels of mental retardation are: (1) borderline mental retardation, (2) mild mental retardation, (3) moderate mental retardation, (4) severe mental retardation, and (5) profound mental retardation.', '(1) Mild mental retardation, (2) minimal mental retardation, (3) moderate mental retardation, (4) major mental retardation, (5) extreme mental retardation', '(1) Severe mental retardation, (2) profound mental retardation, (3) mild mental retardation, (4) borderline mental retardation, (5) moderate mental retardation', '(1) Moderate mental retardation, (2) severe mental retardation, (3) profound mental retardation, (4) borderline mental retardation, (5) mild mental retardation', '(1) Mild mental retardation, (2) moderate mental retardation, (3) severe mental retardation, (4) profound mental retardation, (5) borderline mental retardation']\",\"question\":\"List and define the different levels of mental retardation.\",\"src\":\"stemez-Psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}