{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"19754117-b4f8-5c6b-b343-51cd73602663","task_key":"default--test--11928","task_revision_id":"1","upstream_id":"11928","short_description":"A 115-volt shunt motor has an armature whose resistance is 0.22 ohm. Assuming a…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['25.9 amp and 34.1 amp', '21.7 amp and 30.8 amp', '20.6 amp and 29.7 amp', '19.5 amp and 28.6 amp', '23.5 amp and 32.5 amp', '18.4 amp and 27.7 amp', '22.7 amp and 31.8 amp', '26.2 amp and 35.3 amp', '24.8 amp and 33.9 amp', '17.3 amp and 26.4 amp']\",\"question\":\"A 115-volt shunt motor has an armature whose resistance is 0.22 ohm. Assuming a voltage across the brush contacts of 2 volts, what armature current will flow (a) when the counteremfis 108 volts ? (b) if the motor load is increased so that the counteremfdrops to 106 volts ?\",\"src\":\"stemez-ElectricalMachines\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}