{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8453c311-8ba7-5b4b-bf13-cc7da1fa40c6","task_key":"default--test--11996","task_revision_id":"1","upstream_id":"11996","short_description":"Calculate the full-load torque, in pound-feet and ounce-inches, of a 1/50-hp…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['0.07 lb-ft, 13.4 oz-in, 118%, 37%', '0.07 lb-ft, 12 oz-in, 119%, 39%', '0.08 lb-ft, 14 oz-in, 115%, 35%', '0.10 lb-ft, 16 oz-in, 112%, 33%', '0.09 lb-ft, 15 oz-in, 110%, 34%', '0.05 lb-ft, 10 oz-in, 120%, 40%', '0.05 lb-ft, 9 oz-in, 122%, 41%', '0.06 lb-ft, 11 oz-in, 116%, 36%', '0.04 lb-ft, 8 oz-in, 125%, 42%', '0.06 lb-ft, 12 oz-in, 119%, 38%']\",\"question\":\"Calculate the full-load torque, in pound-feet and ounce-inches, of a 1/50-hp 1,500-rpm shaded-pole motor. A 1/20-hp 1,550-rpm shaded-pole motor has a maximum torqueof 38 oz-in. and a starting torque of 12 oz-in. What percentagesare these torques with respect to the full-load torque?\",\"src\":\"stemez-ElectricalMachines\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}