{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"18a9568a-b234-5909-8cdb-60958caecd2d","task_key":"all--test--18a9568a-b234-5909-8cdb-60958caecd2d","task_revision_id":"1","upstream_id":"","short_description":"A previously healthy 17-year-old girl comes to the physician because of a…","config":"all","split":"test","body":"{\"choices\":\"['Asthma', 'Chronic bronchitis', 'Gastroesophageal reflux disease', 'Postnasal drip syndrome']\",\"question\":\"A previously healthy 17-year-old girl comes to the physician because of a 2-month history of exercise-induced cough and nasal congestion. She plays field hockey and has noticed she coughs when running up and down the field. The cough is nonproductive and resolves with rest. She has not had chest pain or palpitations. She takes no medications and does not smoke. Her sister has asthma. The patient appears well. Her pulse is 68/min, respirations are 16/min, and blood pressure is 100/75 mm Hg. Pulse oximetry on room air shows an oxygen saturation of 99%. Cardiopulmonary examination shows no abnormalities. An x-ray of the chest shows no abnormalities. Spirometry shows an FEV1:FVC ratio of 90% and an FEV1 of 90% of predicted. Which of the following is the most likely diagnosis?\",\"subject\":\"professional_medicine\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}