{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8d781acd-a183-5a24-9823-651435bac1d6","task_key":"default--test--11682","task_revision_id":"1","upstream_id":"11682","short_description":"(a)Whatforce will be required to move a short-circuited conductoracross a…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['3.0 pounds and 6.0 pounds', '0.8 pounds and 1.6 pounds', '1.0 pound and 2.0 pounds', '2.5 pounds and 5.6 pounds', '1.6 pounds and 3.2 pounds', '1.2 pounds and 2.4 pounds', '2.2 pounds and 4.4 pounds', '1.8 pounds and 3.6 pounds', '1.4 pounds and 2.8 pounds', '2.0 pounds and 4.0 pounds']\",\"question\":\"(a)Whatforce will be required to move a short-circuited conductoracross a magnetic field of 5,000 gausses if the conductoris 100 centimeters long, moves at a uniform speedof 100 centimeters per second and the circuit has a resistanceof 0.04 ohm ? (b) What force will be required to force the conductoracross atthe rate of 200 centimeters per second ?\",\"src\":\"stemez-ElectricalMachines\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}