{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0f10c744-41f7-5136-8b9d-5b7fcbb27eb0","task_key":"all--test--0f10c744-41f7-5136-8b9d-5b7fcbb27eb0","task_revision_id":"1","upstream_id":"","short_description":"A 40-year-old man with paranoid schizophrenia is transferred to the emergency…","config":"all","split":"test","body":"{\"choices\":\"['Administration of ipecac to induce vomiting and expectoration of the nail', 'Observation to allow passage of the nail via normal peristalsis', 'Open laparotomy and removal of the nail through a gastrotomy incision', 'Removal of the nail through endoscopic esophagogastroscopy']\",\"question\":\"A 40-year-old man with paranoid schizophrenia is transferred to the emergency department from the residential facility where he lives 2 hours after having swallowed a nail. The patient says he does not have any symptoms. Medical history is otherwise unremarkable. His only current medication is haloperidol. The patient is not in acute distress. Vital signs are normal. Physical examination shows no abnormalities. Mental status examination discloses a flat affect, distractibility, and derailment of thoughts. X-ray of the abdomen is obtained and shows a 4-cm nail in the left upper quadrant. No free air is visible. After admitting the patient to the hospital, which of the following is the most appropriate management?\",\"subject\":\"professional_medicine\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}