{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f0431361-655d-5ba2-a744-10f5751fd079","task_key":"all--test--f0431361-655d-5ba2-a744-10f5751fd079","task_revision_id":"1","upstream_id":"","short_description":"A patient was in the hospital to be treated for an illness. The patient's doctor…","config":"all","split":"test","body":"{\"choices\":\"[\\\"The family must identif' which of the three hospital employees involved \\\\x80\\\\x94the doctor, nurse, and pharmacy technician \\\\x80\\\\x94was actually responsible for the mistake in the dosage of the drug.\\\", 'The family must prove the specific negligent act that resulted in the wrong dose of the drug being administered.', 'The family must show that hospital administrators were negligent in hiring or supervising one or more of the employees involved.', 'The family must prove that the patient would not have died if given 18. 5 milligrams of the drug.']\",\"question\":\"A patient was in the hospital to be treated for an illness. The patient's doctor prescribed a mild anesthetic drug, to be given to the patient intravenously, to reduce the pain being experienced by the patient. The patient was supposed to receive a saline solution containing 18. 5 milligrams of the drug. A nurse arranged to have a pharmacy technician prepare the solution and drug, and then the nurse administered the solution and drug to the patient. The solution that was administered to the patient contained 185 milligrams of the drug, rather than just 18. 5. Shortly after receiving the drug, the patient had a heart attack and died. The doctor, nurse, and pharmacy technician were all employed by the hospital. If the patient's family brings a wrongful death claim against the hospital, which of the following must the family prove in order to recover damages?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}