{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"edcd12ce-514f-57e7-911a-c68b7cad1cbe","task_key":"default--test--2264","task_revision_id":"1","upstream_id":"2264","short_description":"The primary goal of quality assurance is best described as:","config":"default","split":"test","body":"{\"category\":\"psychology\",\"options\":\"['creating a competitive environment among health care providers.', 'minimizing the risk of malpractice lawsuits.', 'policing the profession by detecting and dealing appropriately with incompetent psychologists.', 'promoting the use of cutting-edge technology and treatments.', 'ensuring that all health care professionals have adequate training and certification.', 'guaranteeing that the needs of patients belonging to a particular group or population are being met.', 'improving the health status and satisfaction of patients.', 'preventing the spread of disease and infection within the health care setting.', 'ensuring that all health care facilities are up to code.', 'reducing program costs and beneficiary expenditures.']\",\"question\":\"The primary goal of quality assurance is best described as:\",\"src\":\"ori_mmlu-professional_psychology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}