{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"15bbaf3b-c43e-5b07-926c-ca05a70c43e7","task_key":"all--test--15bbaf3b-c43e-5b07-926c-ca05a70c43e7","task_revision_id":"1","upstream_id":"","short_description":"A 40-year-old female secretary comes to the office because of a 2-month history…","config":"all","split":"test","body":"{\"choices\":\"['Fibromyalgia', 'Myasthenia gravis', 'Polymyositis', 'Scleroderma']\",\"question\":\"A 40-year-old female secretary comes to the office because of a 2-month history of fatigue, and generalized aching and weakness of the proximal muscles of all four extremities. The patient initially noticed the weakness only while she was getting in and out of her car, but during the past 2 weeks, the weakness has progressed, so that she now has difficulty combing her hair. Since the symptoms began, she also has had aching of the joints in her hands that has responded partially to ibuprofen. She was adopted and family history is unknown. She has two teenaged children who are well. She appears uncomfortable. She is 170 cm (5 ft 7 in) tall and weighs 68 kg(150 lb); BMI is 24 kg/m2 . Vital signs are temperature 37.7°C (99.8°F), pulse 90/min, respirations 20/min, and blood pressure 110/70 mm Hg. The patient is alert and fully oriented. Physical examination discloses cracking of the skin of both hands that involves the tips and lateral sides of several fingers. The muscles of the upper arms and legs are somewhat tender to pressure. Results of serum laboratory studies show a creatine kinase concentration of 600 U/L and a lactate dehydrogenase concentration of 800 U/L. Results of complete blood count are within the reference ranges. Which of the following is the most likely diagnosis?\",\"subject\":\"professional_medicine\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}