{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d4156f9e-4b68-514a-86dc-aadf6018d4d1","task_key":"all--test--d4156f9e-4b68-514a-86dc-aadf6018d4d1","task_revision_id":"1","upstream_id":"","short_description":"A 27-year-old man is brought to the emergency department by his sister because…","config":"all","split":"test","body":"{\"choices\":\"['Amphetamine intoxication', 'Bacterial meningitis', 'Delirium tremens', 'Neuroleptic malignant syndrome']\",\"question\":\"A 27-year-old man is brought to the emergency department by his sister because of increasing confusion for 10 hours. He is unable to answer questions. His sister states that he recently saw a psychiatrist for the first time because of hearing voices; he was prescribed a medication, but she is not sure what it is. She says that he has a history of excessive drinking, and she thinks that he has also experimented with illicit drugs. He appears acutely ill. His temperature is 39.1°C (102.3°F), pulse is 124/min, and blood pressure is 160/102 mm Hg. Examination shows profuse diaphoresis and muscle rigidity. His neck is supple. The abdomen is soft and nontender. Mental status examination shows psychomotor agitation alternating with lethargy. His leukocyte count is 15,600/mm3 , and serum creatine kinase activity is 943 U/L. Which of the following is the most likely explanation for this patient's symptoms?\",\"subject\":\"professional_medicine\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}