{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4937e91e-34f8-5b0a-9ee7-6f83c28c1154","task_key":"default--test--6540","task_revision_id":"1","upstream_id":"6540","short_description":"While you are on rounds at a local nursing facility, the nurse mentions that…","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['Abdominal ultrasound', 'Determination of serum albumin concentration', 'Determination of serum sodium level', 'Electrocardiogram', 'Determination of serum digoxin level', 'Renal function tests', 'Complete blood count', 'Chest x-ray', 'Thyroid function tests', 'Stool sample for occult blood']\",\"question\":\"While you are on rounds at a local nursing facility, the nurse mentions that your patient, a 79-year-old woman, appears to be a \\\"poor eater.\\\" She was admitted to the nursing facility 3 months ago from the hospital where she was treated for congestive heart failure. Her daughter had moved away from the area, and nursing home placement was necessary because the patient could no longer function independently. Her present medications include furosemide and digoxin. Physical examination is normal except for a weight loss of 3.5 kg (7 lb) during the past 3 months. In your conversation with the patient, she says, \\\"No, I'm not depressed, I just don't have an appetite anymore. Nothing tastes good to me. I have a little bit of nausea most of the time.\\\" Which of the following is the most appropriate initial diagnostic study?\",\"src\":\"ori_mmlu-professional_medicine\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}