{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4a984e43-50b1-5292-8832-ef3314f4c71a","task_key":"default--test--12072","task_revision_id":"1","upstream_id":"12072","short_description":"A 120 V dc shunt motor having an armature circuit resistance of 0.2 ohm and a…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['Half-load speed: 1870 rpm, 1(1/4) load speed: 1790 rpm', 'Half-load speed: 1780 rpm, 1(1/4) load speed: 1850 rpm', 'Half-load speed: 1900 rpm, 1(1/4) load speed: 1850 rpm', 'Half-load speed: 1800 rpm, 1(1/4) load speed: 1780 rpm', 'Half-load speed: 1750 rpm, 1(1/4) load speed: 1825 rpm', 'Half-load speed: 1830 rpm, 1(1/4) load speed: 1775 rpm', 'Half-load speed: 1860 rpm, 1(1/4) load speed: 1765 rpm', 'Half-load speed: 1820 rpm, 1(1/4) load speed: 1740 rpm', 'Half-load speed: 1800 rpm, 1(1/4) load speed: 1700 rpm', 'Half-load speed: 1840 rpm, 1(1/4) load speed: 1800 rpm']\",\"question\":\"A 120 V dc shunt motor having an armature circuit resistance of 0.2 ohm and a field circuit resistance of 60 ohms, draws a line current of 40 A at full load. The brush volt drop is 3 V and rated, full load speed is 1800 rpm. Calculate: (a) The speed at half load. (b) The speed at an overload of 125 percent.\",\"src\":\"stemez-ElectricalMachines\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}