{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1440c537-8777-5094-8f7c-f048a56a6398","task_key":"default--test--12151","task_revision_id":"1","upstream_id":"12151","short_description":"A three-wire circuit supplies 500 lamps each taking 1/2 ampere; 275 lamps being…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['116 volts across 275 lamps and 122 volts across 225 lamps', '102.5 volts across 275 lamps and 117.5 volts across 225 lamps', '100 volts across 275 lamps and 110 volts across 225 lamps', '137.5 volts across 275 lamps and 112.5 volts across 225 lamps', '108 volts across 275 lamps and 114 volts across 225 lamps', '113 volts across 275 lamps and 117 volts across 225 lamps', '115.5 volts across both sets of lamps', '106.125 volts across 275 lamps and 112.375 volts across 225 lamps', '110 volts across 275 lamps and 120 volts across 225 lamps', '120 volts across both sets of lamps']\",\"question\":\"A three-wire circuit supplies 500 lamps each taking 1/2 ampere; 275 lamps being on one side of the neutral and 225 on the other side, all at a distance of 1,000 feet from a 231- volt three-wire generator. The voltage between the neutral and either outside main is maintained at 115.5 volts at the generator. The outside wires are of No. 0000A.w.g. copper wire and the neutral consists of No. 0 wire. Find the voltage across each set of lamps.\",\"src\":\"stemez-ElectricalMachines\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}