{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5aad0aaa-1c5d-51da-8fc7-33503583c0f8","task_key":"default--test--8859","task_revision_id":"1","upstream_id":"8859","short_description":"A manufacturer of corrugated metal roofing wants to produce panels that are $28…","config":"default","split":"test","body":"{\"category\":\"math\",\"options\":\"['32.07 in', '29.36 $\\\\\\\\mathrm{in}$', '34.88 in', '30.62 $\\\\\\\\mathrm{in}$', '28.85 $\\\\\\\\mathrm{in}$', '31.42 in', '33.50 in', '26.18 in', '27.90 $\\\\\\\\mathrm{in}$', '28.00 in']\",\"question\":\"A manufacturer of corrugated metal roofing wants to produce panels that are $28 \\\\mathrm{in}$. wide and $2 \\\\mathrm{in}$. thick by processing flat sheets of metal as shown in the figure. The profile of the roofing takes the shape of a sine wave. Verify that the sine curve has equation $y=\\\\sin (\\\\pi x / 7)$ and find the width $w$ of a flat metal sheet that is needed to make a 28-inch panel. (Use your calculator to evaluate the integral correct to four significant digits.)\\n\",\"src\":\"scibench-calculus\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}