{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cb42e5ed-9465-5e37-95a8-2a8fffb7cbf6","task_key":"all--test--cb42e5ed-9465-5e37-95a8-2a8fffb7cbf6","task_revision_id":"1","upstream_id":"","short_description":"A 46-year-old man with Marfan syndrome, aortic insufficiency, and mitral…","config":"all","split":"test","body":"{\"choices\":\"['Acute bacterial endocarditis', 'Acute myocardial infarction', 'Dissection of the aorta', 'Esophageal reflux with spasm']\",\"question\":\"A 46-year-old man with Marfan syndrome, aortic insufficiency, and mitral regurgitation comes to the emergency department because he has had severe substernal chest pain for the past 3 hours. He describes the pain as tearing in quality and radiating to the neck. One week earlier he experienced similar but less severe chest pain and treated himself with aspirin. Which of the following is the most likely underlying cause for his worsening symptoms?\",\"subject\":\"professional_medicine\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}