{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a6171303-92aa-53aa-acfb-62bf5e392f0a","task_key":"default--test--11756","task_revision_id":"1","upstream_id":"11756","short_description":"The axial-flow fan of a laboratory wind tunnel produces an air velocity of 65…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['1500 rpm and 8.5 hp', '1650 rpm and 9.5 hp', '2100 rpm and 15 hp', '1846 rpm and 10.9 hp', '1950 rpm and 14 hp', '1800 rpm and 11.5 hp', '1750 rpm and 10.5 hp', '2000 rpm and 9 hp', '1900 rpm and 11 hp']\",\"question\":\"The axial-flow fan of a laboratory wind tunnel produces an air velocity of 65 fps at the test section when driven by a 3-hp motor at a speed of 1200 rpm. What motor speed and power would be required to increase the velocity to 100 fps ?\",\"src\":\"stemez-FluidMechanics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}