{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"44ed4c4c-6d58-5937-a21e-4ca0e7bcd115","task_key":"default--test--11744","task_revision_id":"1","upstream_id":"11744","short_description":"Superheated steam enters an adiabatic turbine at 400 lbf/in^2, 600°F and leaves…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['Turbine efficiency: 69%, Effectiveness: 87%, Loss of available energy: -33 Btu/lbm', 'Turbine efficiency: 78%, Effectiveness: 83%, Loss of available energy: -28 Btu/lbm', 'Turbine efficiency: 82%, Effectiveness: 77%, Loss of available energy: -25 Btu/lbm', 'Turbine efficiency: 72%, Effectiveness: 79%, Loss of available energy: -31 Btu/lbm', 'Turbine efficiency: 80%, Effectiveness: 75%, Loss of available energy: -30 Btu/lbm', 'Turbine efficiency: 75%, Effectiveness: 80%, Loss of available energy: -40 Btu/lbm', 'Turbine efficiency: 70%, Effectiveness: 85%, Loss of available energy: -35 Btu/lbm', 'Turbine efficiency: 76%, Effectiveness: 84%, Loss of available energy: -27 Btu/lbm', 'Turbine efficiency: 74.5%, Effectiveness: 81%, Loss of available energy: -32.6 Btu/lbm', 'Turbine efficiency: 65%, Effectiveness: 90%, Loss of available energy: -37 Btu/lbm']\",\"question\":\"Superheated steam enters an adiabatic turbine at 400 lbf/in^2, 600°F and leaves at a pressure of 50 lbf/in^2 and a quality of 99.5%. If the temperature of the surroundings (T_0) is 60°F, calculate the turbine efficiency, effectiveness, and loss of available energy.\",\"src\":\"stemez-Thermodynamics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}