{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b277c9b1-cf4e-5f6c-893f-01a4c1519ff5","task_key":"default--test--11460","task_revision_id":"1","upstream_id":"11460","short_description":"When the field rheostat is cut out, a 230-volt shunt motor generatesa…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['6.35 amperes, 54.2 amperes', '3.35 amperes, 53.2 amperes', '4.00 amperes, 52.2 amperes', '5.35 amperes, 53.2 amperes', '5.35 amperes, 51.2 amperes', '4.35 amperes, 52.2 amperes', '4.35 amperes, 51.2 amperes', '3.35 amperes, 50.2 amperes', '4.35 amperes, 53.2 amperes', '4.35 amperes, 55.2 amperes']\",\"question\":\"When the field rheostat is cut out, a 230-volt shunt motor generatesa counteremfof 220 volts at no load. The resistanceof the armature is 2.3 ohms and that of the field is 115 ohms.Calculate the (a) Current through the armature when the field rheostat is cutout. (b) Current through the armature when sufficient external resistancehas been inserted in the field circuit to make the fieldcurrent one-half as great.\",\"src\":\"stemez-ElectricalMachines\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}