{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c6989e00-ba57-5a1f-a0ec-9ec904e31224","task_key":"default--test--6564","task_revision_id":"1","upstream_id":"6564","short_description":"After being severely beaten and sustaining a gunshot wound to the abdomen, a…","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['Encourage the patient to endure the pain without medication to prevent addiction', 'Reassure the patient that her chance of becoming addicted to narcotics is minuscule', 'Administer methadone as an alternative to morphine', 'Increase the dose of morphine to relieve her anxiety', 'Suggest biofeedback therapy to control pain', 'Switch the patient to oral acetaminophen as soon as she can take medication orally', 'Maintain the morphine, but periodically administer intravenous naloxone', 'Recommend a consultation with a psychiatrist to address her fears of addiction', 'Switch the patient to intramuscular lorazepam', 'Advise her to drink more wine to help with the pain']\",\"question\":\"After being severely beaten and sustaining a gunshot wound to the abdomen, a 42-year-old woman undergoes resection of a perforated small bowel. During the operation, plastic reconstruction of facial fractures, and open reduction and internal fixation of the left femur are also done. Thirty-six hours postoperatively, she is awake but not completely alert. She is receiving intravenous morphine via a patient-controlled pump. She says that she needs the morphine to treat her pain, but she is worried that she is becoming addicted. She has no history of substance use disorder. She drinks one to two glasses of wine weekly. Which of the following initial actions by the physician is most appropriate? \",\"src\":\"ori_mmlu-professional_medicine\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}