{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"90423ca9-68e0-54e1-873b-7f395ca54f3d","task_key":"default--test--6547","task_revision_id":"1","upstream_id":"6547","short_description":"A 52-year-old man is admitted to the hospital because of severe dyspnea and…","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['Lung transplantation', 'Continuous humidified oxygen', 'Azathioprine therapy', 'Bronchoscopy', 'Corticosteroid therapy', 'Nocturnal continuous positive airway pressure (CPAP)']\",\"question\":\"A 52-year-old man is admitted to the hospital because of severe dyspnea and cough productive of tenacious, brownishyellow sputum for the past 3 weeks. He has a 15-year career history of sandblasting old buildings. He has smoked two packs of cigarettes daily for the past 30 years. The patient is 168 cm (5 ft 6 in) tall and weighs 59 kg (130 lb); BMI is 21 kg/m2 . Vital signs are temperature 36.8°C (98.2°F), pulse 94/min, and blood pressure 150/92 mm Hg. Pulse oximetry on room air shows an oxygen saturation of 70%. On physical examination he is in moderately severe distress with pursed lips and cyanotic nail beds. Chest has an increased anteroposterior diameter. Auscultation of the chest discloses scattered wheezes and rhonchi over all lung fields. Cardiac examination discloses muffled heart sounds and an S4. Fingers are clubbed. Chest x-ray shows hyperinflated lungs, flattened diaphragm, large, irregular opacities in the upper lobes, and eggshell calcifications of the hilar lymph nodes. In addition to antibiotic therapy, which of the following is the most appropriate intervention?\",\"src\":\"ori_mmlu-professional_medicine\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}