{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0fb4e7aa-1b7b-5685-9e97-6a2276708668","task_key":"all--test--0fb4e7aa-1b7b-5685-9e97-6a2276708668","task_revision_id":"1","upstream_id":"","short_description":"A 28-year-old man comes to the office because he would like to quit smoking…","config":"all","split":"test","body":"{\"choices\":\"['Hypertension', 'Polyuria', 'Renal insufficiency', 'The patient is at no increased risk']\",\"question\":\"A 28-year-old man comes to the office because he would like to quit smoking cigarettes. He says, \\\"I cannot go more than a day without cigarettes because I get so anxious and irritable. I even wake up at night to smoke.\\\" The patient began smoking cigarettes at age 12 years; he was smoking two packs of cigarettes daily by age 17 years, and he has not curtailed his use since that time. He does not drink alcoholic beverages or use illicit drugs. Medical history is remarkable for childhood febrile seizures. He takes no medications. Vital signs are normal. The patient is interested in using a nicotine patch and bupropion therapy because he says his friend found the treatments to be helpful. In combining these two therapies, this patient is at greatest risk for which of the following?\",\"subject\":\"professional_medicine\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}