{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"aaa074f6-e564-5702-bc19-40501cf43159","task_key":"default--test--12102","task_revision_id":"1","upstream_id":"12102","short_description":"A driver applies brakes and slows down the car at a constant rate of 25 fps^2…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['Temperature increase: 110°F, Mean rate of power absorption in the first second: 350 hp, Average power absorbed overall: 210 hp', 'Temperature increase: 65°F, Mean rate of power absorption in the first second: 250 hp, Average power absorbed overall: 140 hp', 'Temperature increase: 99°F, Mean rate of power absorption in the first second: 337 hp, Average power absorbed overall: 199 hp', 'Temperature increase: 85°F, Mean rate of power absorption in the first second: 290 hp, Average power absorbed overall: 160 hp', 'Temperature increase: 80°F, Mean rate of power absorption in the first second: 265 hp, Average power absorbed overall: 150 hp', 'Temperature increase: 120°F, Mean rate of power absorption in the first second: 375 hp, Average power absorbed overall: 205 hp', 'Temperature increase: 92°F, Mean rate of power absorption in the first second: 300 hp, Average power absorbed overall: 175 hp', 'Temperature increase: 75°F, Mean rate of power absorption in the first second: 320 hp, Average power absorbed overall: 180 hp', 'Temperature increase: 88°F, Mean rate of power absorption in the first second: 310 hp, Average power absorbed overall: 170 hp', 'Temperature increase: 105°F, Mean rate of power absorption in the first second: 400 hp, Average power absorbed overall: 220 hp']\",\"question\":\"A driver applies brakes and slows down the car at a constant rate of 25 fps^2 till it comes to rest. The car weighs 3500 lbs. and its average speed is 55 mph. If the drum diameter is 10 in., band face width and thickness are 2 in. and (1 / 4) in. respectively, determine the following: (a) the temperature increase in the drum due to heat absorption, (b) mean rate at which the drum absorbs power in the first second, (c) average power absorbed on the whole.\",\"src\":\"stemez-MachineDesign\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}