{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"41217169-5eb7-5505-a2b7-5fa42c1769b0","task_key":"default--test--6189","task_revision_id":"1","upstream_id":"6189","short_description":"An 18-year-old primigravid woman comes for her initial prenatal visit at 16…","config":"default","split":"test","body":"{\"category\":\"health\",\"options\":\"['Immediate cesarean section', 'Prescribe oral contraceptives', 'Amniocentesis for measurement of α-fetoprotein concentration', 'Administer a pregnancy test', 'Hormone therapy to balance MSAFP levels', 'Ultrasonography', 'Conduct a pelvic exam', 'Triple screening for MSAFP, serum β-hCG, and serum estriol concentrations', 'Repeat measurement of MSAFP concentration', 'Monitor patient without taking action']\",\"question\":\"An 18-year-old primigravid woman comes for her initial prenatal visit at 16 weeks' gestation. She is not sure about the date of her last menstrual period but says that the pregnancy probably occurred immediately after she stopped taking oral contraceptives 5 months ago. Maternal serum α-fetoprotein (MSAFP) concentration is increased to 3 multiples of the median. Which of the following is the most appropriate next step in management? \",\"src\":\"ori_mmlu-professional_medicine\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}