{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0fd410ea-7766-51cb-9b67-131998fbbd1f","task_key":"all--test--0fd410ea-7766-51cb-9b67-131998fbbd1f","task_revision_id":"1","upstream_id":"","short_description":"A 5-year-old boy is brought to the physician because of a 2-day history of fever…","config":"all","split":"test","body":"{\"choices\":\"['Developmental arrest of maturation of B lymphocytes', 'Dysmorphogenesis of the third and fourth pharyngeal pouches', 'Impaired chemotaxis', 'Impaired phagocytic oxidative metabolism']\",\"question\":\"A 5-year-old boy is brought to the physician because of a 2-day history of fever and painful swelling of the left ankle. He has had recurrent cervical lymphadenitis and pneumonia since infancy. Two years ago, a culture from an abscess in the cervical region grew Staphylococcus aureus. His temperature is 38°C (100.4°F). Examination shows a tender, erythematous, edematous left ankle; there is point tenderness over the medial malleolus. A bone scan shows increased uptake in the left lower tibial metaphysis. Culture of bone aspirate grows Serratia marcescens. Nitroblue tetrazolium test shows no color change. Which of the following is the most likely mechanism for these findings?\",\"subject\":\"professional_medicine\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}