{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"05da0466-7c55-571f-ab53-806a51386681","task_key":"default--test--6496","task_revision_id":"1","upstream_id":"6496","short_description":"A 42-year-old man comes to the physician for a follow-up examination. Four…","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"[\\\"The patient's dissatisfaction with the outcome of the surgery\\\", \\\"The patient's unrealistic expectations of the surgery's results\\\", \\\"The patient's perception that the physician is uncaring\\\", \\\"The patient's belief that the physician did not take his concerns seriously\\\", \\\"The patient's perception that the physician is incompetent\\\", \\\"The patient's socioeconomic status\\\", \\\"The patient's perception that the physician is unprofessional\\\", \\\"The physician's amount of experience in the medical field\\\", \\\"The patient's perception that the physician did not spend enough time with him\\\", \\\"The patient's belief that the physician did not explain the risks of the surgery\\\"]\",\"question\":\"A 42-year-old man comes to the physician for a follow-up examination. Four months ago, he underwent repair of a Dupuytren contracture. Physical examination shows decreased range of motion in the affected hand. The patient is upset that his hand has not fully healed, and he files a malpractice suit against the physician. Which of the following is the most likely precipitating factor in this patient's decision to file a malpractice suit?\",\"src\":\"ori_mmlu-professional_medicine\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}