{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cc40570d-f817-57b0-b497-9683c20ed8c3","task_key":"all--test--cc40570d-f817-57b0-b497-9683c20ed8c3","task_revision_id":"1","upstream_id":"","short_description":"A 68-year-old man is in the hospital because he requires mechanical ventilation…","config":"all","split":"test","body":"{\"choices\":\"['Administer β-blocking medications', 'Administer alprazolam', 'Remove the patient from the ventilator and ventilate him with a bag-valve mask', 'Reposition the chest tube']\",\"question\":\"A 68-year-old man is in the hospital because he requires mechanical ventilation for an exacerbation of chronic obstructive pulmonary disease. On the second day after admission he developed a pneumothorax on the right side that required tube thoracostomy. An air leak is noted for the next 24 hours, which now has stopped. However, the patient has become restless and combative. Breath sounds are diminished in the right side of the chest and the patient now has tachycardia. Blood pressure is 130/80 mm Hg. After ordering a STAT portable x-ray of the chest, which of the following is the most appropriate step?\",\"subject\":\"professional_medicine\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}