{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"380291a0-dd9d-5a5c-85e7-2352ee70f4f7","task_key":"default--test--12214","task_revision_id":"1","upstream_id":"12214","short_description":"Consider a lap-wound armature 4 feet in diameter, having 12 poles. The winding…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['175', '180', '240', '250', '220', '200', '230', '196.5', '205.7', '213.4']\",\"question\":\"Consider a lap-wound armature 4 feet in diameter, having 12 poles. The winding consists of 240 coils of 4 turns each and the length of the pole face is 10 inches. Sixty percent of the conductors lie under the pole face where the flux density is 60,000 lines per square inch, and 15 percent lie in the pole fringe where the average density is 35,000 lines per square inch. What horsepower is the motor developing if the current flowing into the armature is 480 amperes and the machine is rotating at 200r.p.m. ?\",\"src\":\"stemez-ElectricalMachines\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}