{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f62a219c-743a-55be-9346-4177ed6001fb","task_key":"all--test--f62a219c-743a-55be-9346-4177ed6001fb","task_revision_id":"1","upstream_id":"","short_description":"A 32-year-old woman, gravida 3, para 2, at 41 weeks' gestation is admitted to…","config":"all","split":"test","body":"{\"choices\":\"['Amniotic fluid embolism', 'Intracerebral hemorrhage', 'Myocardial infarction', 'Status asmaticus']\",\"question\":\"A 32-year-old woman, gravida 3, para 2, at 41 weeks' gestation is admitted to the hospital in active labor. Pregnancy has been complicated by mild asthma treated with inhaled bronchodilators. At the beginning of the second stage of labor, the cervix is 100% effaced and 10 cm dilated; the vertex is at -1 station. The fetal heart rate is reactive with no decelerations. After 10 minutes of pushing, there is a prolonged deceleration to 60/min. The patient has the acute onset of shortness of breath, rapidly develops cyanosis, and becomes unresponsive. Her pulse and blood pressure cannot be detected. Immediate resuscitation is started. Five minutes later, there is bleeding from the nose, mouth, and intravenous sites. Which of the following is the most likely diagnosis?\",\"subject\":\"professional_medicine\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}