{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"59345dd5-e969-5c71-b6d0-ddf0bc1bcf88","task_key":"default--test--6230","task_revision_id":"1","upstream_id":"6230","short_description":"A 37-year-old woman with AIDS comes to the physician because of a 1-month…","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['Cryptosporidium parvum', 'Cytomegalovirus', 'Mycobacterium avium-intracellulare complex', 'Salmonella enteritidis']\",\"question\":\"A 37-year-old woman with AIDS comes to the physician because of a 1-month history of progressive diarrhea and a 1.8- kg (4-lb) weight loss. During the past week, she has had six large watery stools daily. She is currently receiving triple antiretroviral therapy. She is employed as a flight attendant and works regularly on domestic flights throughout the USA. She also flies to Asia at least once monthly. She is 163 cm (5 ft 4 in) tall and weighs 59 kg (130 lb); BMI is 22 kg/m2 . Her temperature is 37°C (98.6°F), pulse is 88/min, and blood pressure is 112/64 mm Hg. The abdomen is scaphoid. The remainder of the examination shows no abnormalities. Her CD4+ T-lymphocyte count is 400/mm3 (Normal≥500). Which of the following is the most likely causal organism?\",\"src\":\"ori_mmlu-professional_medicine\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}