{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cfce1de8-3635-5366-ae1a-b7b959cce4b9","task_key":"default--test--11523","task_revision_id":"1","upstream_id":"11523","short_description":"(i) How much energy is used by a 1,500-watt heater in 8 hr? (ii) A 12-kw load is…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['9kwhr, 1440 watts, 720 watts', '14kwhr, 2100 watts, 300 watts', '11kwhr, 1800 watts, 450 watts', '15kwhr, 2500 watts, 400 watts', '12kwhr, 2000 watts, 500 watts', '10kwhr, 1500 watts, 600 watts', '11.5kwhr, 1900 watts, 520 watts', '12kwhr, 2200 watts, 440 watts', '12.5kwhr, 1700 watts, 560 watts', '13kwhr, 1600 watts, 480 watts']\",\"question\":\"(i) How much energy is used by a 1,500-watt heater in 8 hr? (ii) A 12-kw load is supplied from a line that has a resistance of 0.1 ohm in each conductor. Find the line loss in watts when the load is supplied at (a) 120 volts and (b) 240 volts.\",\"src\":\"stemez-ElectricalMachines\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}