{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"53174556-af0c-59e9-abdc-b6f3e7f243ea","task_key":"default--test--8630","task_revision_id":"1","upstream_id":"8630","short_description":"A CAT scan produces equally spaced cross-sectional views of a human organ that…","config":"default","split":"test","body":"{\"category\":\"math\",\"options\":\"['1250 $\\\\\\\\mathrm{cm}^3$', '1010 $\\\\\\\\mathrm{cm}^3$', '950 $\\\\\\\\mathrm{cm}^3$', '890 $\\\\\\\\mathrm{cm}^3$', '980 $\\\\\\\\mathrm{cm}^3$', '1200 $\\\\\\\\mathrm{cm}^3$', '1150 $\\\\\\\\mathrm{cm}^3$', '1300 $\\\\\\\\mathrm{cm}^3$', '1110 $\\\\\\\\mathrm{cm}^3$', '1050 $\\\\\\\\mathrm{cm}^3$']\",\"question\":\"A CAT scan produces equally spaced cross-sectional views of a human organ that provide information about the organ otherwise obtained only by surgery. Suppose that a CAT scan of a human liver shows cross-sections spaced $1.5 \\\\mathrm{~cm}$ apart. The liver is $15 \\\\mathrm{~cm}$ long and the cross-sectional areas, in square centimeters, are $0,18,58,79,94,106,117,128,63$, 39 , and 0 . Use the Midpoint Rule to estimate the volume of the liver.\\n\",\"src\":\"scibench-calculus\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}