{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"711c6df5-4895-54f8-8eb6-6d223b059c9d","task_key":"default--test--8762","task_revision_id":"1","upstream_id":"8762","short_description":"A hawk flying at $15 \\mathrm{~m} / \\mathrm{s}$ at an altitude of $180…","config":"default","split":"test","body":"{\"category\":\"math\",\"options\":\"['225.0 m', '198.7 $\\\\\\\\mathrm{m}$', '235.3 $\\\\\\\\mathrm{m}$', '215.9 m', '202.7 m', '209.1 $\\\\\\\\mathrm{m}$', '245.6 m', '190.4 m', '220.5 $\\\\\\\\mathrm{m}$', '180.0 m']\",\"question\":\"A hawk flying at $15 \\\\mathrm{~m} / \\\\mathrm{s}$ at an altitude of $180 \\\\mathrm{~m}$ accidentally drops its prey. The parabolic trajectory of the falling prey is described by the equation\\n$$\\ny=180-\\\\frac{x^2}{45}\\n$$\\nuntil it hits the ground, where $y$ is its height above the ground and $x$ is the horizontal distance traveled in meters. Calculate the distance traveled by the prey from the time it is dropped until the time it hits the ground. Express your answer correct to the nearest tenth of a meter.\",\"src\":\"scibench-calculus\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}