{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e9724605-91bf-5757-aeb1-ef3f95efcabc","task_key":"default--test--8634","task_revision_id":"1","upstream_id":"8634","short_description":"The orbit of Halley's comet, last seen in 1986 and due to return in 2062, is an…","config":"default","split":"test","body":"{\"category\":\"math\",\"options\":\"['32.10 $\\\\\\\\mathrm{AU}$', '37.86 $\\\\\\\\mathrm{AU}$', '29.85 $\\\\\\\\mathrm{AU}$', '31.50 $\\\\\\\\mathrm{AU}$', '33.25 $\\\\\\\\mathrm{AU}$', '38.76 $\\\\\\\\mathrm{AU}$', '40.22 $\\\\\\\\mathrm{AU}$', '28.93 $\\\\\\\\mathrm{AU}$', '34.52 $\\\\\\\\mathrm{AU}$', '35.64 $\\\\\\\\mathrm{AU}$']\",\"question\":\"The orbit of Halley's comet, last seen in 1986 and due to return in 2062, is an ellipse with eccentricity 0.97 and one focus at the sun. The length of its major axis is $36.18 \\\\mathrm{AU}$. [An astronomical unit (AU) is the mean distance between the earth and the sun, about 93 million miles.] Find a polar equation for the orbit of Halley's comet. What is the maximum distance from the comet to the sun?\",\"src\":\"scibench-calculus\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}