{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"78e56f6d-4381-5294-bb1d-d24f12d1a5ac","task_key":"all--test--78e56f6d-4381-5294-bb1d-d24f12d1a5ac","task_revision_id":"1","upstream_id":"","short_description":"A 26-year-old male police officer comes to the office for an annual health…","config":"all","split":"test","body":"{\"choices\":\"['Chest x-ray', 'Fexofenadine therapy', 'Increased use of the albuterol inhaler', 'Initiation of a daily corticosteroid inhaler']\",\"question\":\"A 26-year-old male police officer comes to the office for an annual health maintenance examination. He is physically active and feels well, but he notes that his asthma has been more active during the past month. He says that he has had to use his albuterol inhaler one to two times daily for wheezing and chest tightness. He has not had gastroesophageal reflux symptoms, productive cough, or fever. Medical history is remarkable for atopic allergies, especially to pollen and cats. He has had coldand exercise-induced asthma for the past 14 years. He takes no other medications. He is 188 cm (6 ft 2 in) tall and weighs 90 kg (200 lb); BMI is 25 kg/m2 . Vital signs are temperature 37.0°C (98.6°F), pulse 70/min, respirations 12/min, and blood pressure 120/76 mm Hg. Physical examination shows no abnormalities except for scattered rhonchi and wheezes with forced expiration. Peak expiratory flow rate is 240 L/min. Which of the following is the most appropriate management?\",\"subject\":\"professional_medicine\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}