{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e9b0abab-0ea0-5007-a6a0-4faf089b1786","task_key":"default--test--11459","task_revision_id":"1","upstream_id":"11459","short_description":"A four-pole generator has 500 conductors on the armature. If the generator is…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['(a) 180 volts, (b) 360 volts', '(a) 275 volts, (b) 550 volts', '(a) 350 volts, (b) 175 volts', '(a) 400 volts, (b) 800 volts', '(a) 250 volts, (b) 500 volts', '(a) 200 volts, (b) 100 volts', '(a) 150 volts, (b) 300 volts', '(a) 600 volts, (b) 300 volts', '(a) 120 volts, (b) 240 volts', '(a) 100 volts, (b) 200 volts']\",\"question\":\"A four-pole generator has 500 conductors on the armature. If the generator is running at 1200 rpm, find the average voltage generated between brushes for (a) a lap winding, (b) a wave winding. The total flux per pole is 10^6 lines.\",\"src\":\"stemez-ElectricalMachines\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}