{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"08599fcb-52eb-5e4f-8971-a5a5c9e4f62e","task_key":"default--test--11923","task_revision_id":"1","upstream_id":"11923","short_description":"Determine the force in pounds upon each side of a coil of 40 turns carrying a…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['10.6 1b on each side of the coil', '15 1b on each side of the coil', '12.5 1b on each side of the coil', '8.6 1b on each side of the coil']\",\"question\":\"Determine the force in pounds upon each side of a coil of 40 turns carrying a current of 15 amp if the axial length of the coil is 10 in. and the flux density is 20,000 lines per square inch. The conductors are at right angles to the flux. There are 4.448 × 10^5 dynes in a pound.\",\"src\":\"stemez-ElectricalMachines\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}