{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d90b8779-0528-5a90-bf77-1d80618bcd4a","task_key":"all--test--d90b8779-0528-5a90-bf77-1d80618bcd4a","task_revision_id":"1","upstream_id":"","short_description":"A 57-year-old woman comes to the physician because of an 8-week history of…","config":"all","split":"test","body":"{\"choices\":\"['Donepezil therapy', 'Ferrous sulfate therapy', 'Ginkgo biloba extract therapy', 'Paroxetine therapy']\",\"question\":\"A 57-year-old woman comes to the physician because of an 8-week history of difficulty sleeping, fatigue, and muscle tension. During this period, she also has had memory lapses, difficulty concentrating, and has been reprimanded at work for arriving late. Over the past 2 weeks, she has had three episodes of palpitations and shortness of breath that have awakened her from sleep. Her pulse is 80/min, and blood pressure is 110/90 mm Hg. Physical examination shows no abnormalities. Mental status examination shows a depressed mood and constricted affect. She says that she is no longer interested in activities that she used to enjoy. She has suicidal ideation without a plan. Her hemoglobin concentration is 11 g/dL, and serum ferritin concentration is 140 ng/mL. Which of the following is the most appropriate initial step in treatment?\",\"subject\":\"professional_medicine\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}