{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2ffd91f6-72f8-5b16-9b1f-c05c83fa9aac","task_key":"all--test--2ffd91f6-72f8-5b16-9b1f-c05c83fa9aac","task_revision_id":"1","upstream_id":"","short_description":"A 40-year-old male presents to the office with symptoms of odynophagia and…","config":"all","split":"test","body":"{\"choices\":\"['prescription for a proton pump inhibitor and a prokinetic agent', 'prescription for an H2-blocker trial for 6 weeks', 'prescription for clotrimazole troches', 'referral for an upper endoscopy with biopsy']\",\"question\":\"A 40-year-old male presents to the office with symptoms of odynophagia and gastroesophageal reflux. He also says that he experienced hematemesis once last week. Past medical history reveals AIDS, and his most recent CD4 count was 30 cells/mcL. The patient's tilt test result and hemoglobin level are normal. Rectal examination demonstrates brown stool that is positive for occult blood. What is the most appropriate initial step in this patient's management?\",\"subject\":\"professional_medicine\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}