{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8544ebfc-92c6-577e-84a4-939ee1025bec","task_key":"all--test--8544ebfc-92c6-577e-84a4-939ee1025bec","task_revision_id":"1","upstream_id":"","short_description":"A 67-year-old woman comes to the physician because of dizziness for 6 weeks.…","config":"all","split":"test","body":"{\"choices\":\"['Cardiac stress scintigraphy', 'Adjusting her medication regimen', 'Warfarin therapy', 'Transesophageal echocardiography']\",\"question\":\"A 67-year-old woman comes to the physician because of dizziness for 6 weeks. When she stands up suddenly, she becomes light-headed and has to steady herself for approximately 1 to 2 minutes before she is able to walk. She has hypertension and type 2 diabetes mellitus. Current medications include glyburide, a diuretic, a β-adrenergic blocking agent, and an angiotensinconverting enzyme (ACE) inhibitor. Her pulse is 55/min. Her blood pressure is 110/70 mm Hg in the right arm and 70/50 mm Hg in the left arm while supine; her blood pressure is 70/50 mm Hg in the right arm and 50/30 mm Hg in the left arm immediately after standing. Neurologic examination shows no focal findings. An ECG shows sinus bradycardia with no evidence of ischemia. Carotid duplex ultrasonography shows reverse flow in the left vertebral artery with no evidence of occlusion. Which of the following is the most appropriate next step in management?\",\"subject\":\"professional_medicine\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}