{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"02b66d4e-724d-5d55-9331-69f1e9e65b20","task_key":"default--test--12161","task_revision_id":"1","upstream_id":"12161","short_description":"(a) A 4-pole machine has lap winding with 36 winding elements. What are the back…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['Back pitch for lap winding is 12, front pitch is 13. Back pitch for wave winding is 7, front pitch is 6 or 7.', 'Back pitch for lap winding is 9, front pitch is 10. Back pitch for wave winding is 9, front pitch is 8 or 9.', 'Back pitch for lap winding is 8, front pitch is 9. Back pitch for wave winding is 10, front pitch is 11 or 12.', 'Back pitch for both windings is 8, front pitch is 9 or 10.', 'Back pitch for both windings is 9, front pitch is 11 or 12.', 'Back pitch for lap winding is 11, front pitch is 9. Back pitch for wave winding is 10, front pitch is 8 or 9.', 'Back pitch for lap winding is 7, front pitch is 6. Back pitch for wave winding is 11, front pitch is 12 or 13.', 'Back pitch for lap winding is 10, front pitch is 8. Back pitch for wave winding is 9, front pitch is 9 or 10.', 'Back pitch for lap winding is 10, front pitch is 11. Back pitch for wave winding is 8, front pitch is 7 or 8.', 'Back pitch for lap winding is 9, front pitch is 8. Back pitch for wave winding is 9, front pitch is 9 or 10.']\",\"question\":\"(a) A 4-pole machine has lap winding with 36 winding elements. What are the back and front pitches of this winding, expressed in commutator bars? (b) A 4-pole machine has wave winding with 37 winding elements. What are the three pitches of this winding expressed in commutator bars?\",\"src\":\"stemez-ElectricalMachines\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}