{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a2219d49-8414-5acb-95da-a75be0e6b5ef","task_key":"default--test--11381","task_revision_id":"1","upstream_id":"11381","short_description":"A 25-hp 240-volt series motor takes 93 amp when driving its ratedload at 800…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['2,100 rpm', '950 rpm', '1,400 rpm', '1,800 rpm', '800 rpm', '1,550 rpm', '2,000 rpm', '2,500 rpm', '1,690 rpm', '1,200 rpm']\",\"question\":\"A 25-hp 240-volt series motor takes 93 amp when driving its ratedload at 800 rpm. The armature resistance is 0.12 ohm, andthe series-field resistance is 0.08 ohm. At what speed willthe motor operate if the load is partially removed so that themotor takes 31 amp ? Assume that the flux is reduced by 50 percent for a current drop of 66 2/3 percent and that the brushdrop is 2 volts at both loads.\",\"src\":\"stemez-ElectricalMachines\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}