{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d4ce87d2-97fe-5f8e-9e39-7f148c3dee41","task_key":"default--test--6559","task_revision_id":"1","upstream_id":"6559","short_description":"A previously healthy 14-year-old girl is brought to the physician because of a…","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['MRI of the right knee', 'X-ray of the right knee', 'Surgical intervention', 'Physiotherapy', 'Non-steroidal anti-inflammatory drug therapy', 'Nuclear scan of the right knee', 'Antibiotic therapy', 'Corticosteroid injection', 'Application of a knee brace', 'Arthrocentesis']\",\"question\":\"A previously healthy 14-year-old girl is brought to the physician because of a 2-day history of fever and pain and swelling of the right knee. She remembers injuring the knee while playing soccer last week, but she was able to finish the game. She has no history of rash or joint pain. Her sister has inflammatory bowel disease. The patient's temperature is 39°C (102.2°F), blood pressure is 110/80 mm Hg, pulse is 95/min, and respirations are 20/min. Examination of the right knee shows swelling, tenderness, warmth, and erythema; range of motion is limited. Which of the following is the most appropriate next step in management?\",\"src\":\"ori_mmlu-professional_medicine\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}