{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"adc99acb-ad65-5010-8204-fe0b64c561b1","task_key":"all--test--adc99acb-ad65-5010-8204-fe0b64c561b1","task_revision_id":"1","upstream_id":"","short_description":"A 22-year-old man is brought to the emergency department 30 minutes after he…","config":"all","split":"test","body":"{\"choices\":\"['CT scan of the chest', 'Intubation and mechanical ventilation', 'Peritoneal lavage', 'Left tube thoracostomy']\",\"question\":\"A 22-year-old man is brought to the emergency department 30 minutes after he sustained a gunshot wound to the abdomen. His pulse is 120/min, respirations are 28/min, and blood pressure is 70/40 mm Hg. Breath sounds are normal on the right and decreased on the left. Abdominal examination shows an entrance wound in the left upper quadrant at the midclavicular line below the left costal margin. There is an exit wound laterally in the left axillary line at the 4th rib. Intravenous fluid resuscitation is begun. Which of the following is the most appropriate next step in management?\",\"subject\":\"professional_medicine\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}