{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0087c2ff-50df-5280-95d0-52d49d4dd0e7","task_key":"default--test--11567","task_revision_id":"1","upstream_id":"11567","short_description":"Consider a vertical cylinder which has an outside diameter of 1.0 ft and is 2.0…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['Overall heat transfer coefficient: 1025 Btu/hr-ft^2-°F, Total rate of heat transfer: 128,000 Btu/hr, Total rate of condensation: 98 lb/hr', 'Overall heat transfer coefficient: 800 Btu/hr-ft^2-°F, Total rate of heat transfer: 100,000 Btu/hr, Total rate of condensation: 80 lb/hr', 'Overall heat transfer coefficient: 1100 Btu/hr-ft^2-°F, Total rate of heat transfer: 130,000 Btu/hr, Total rate of condensation: 100 lb/hr', 'Overall heat transfer coefficient: 1000 Btu/hr-ft^2-°F, Total rate of heat transfer: 119,000 Btu/hr, Total rate of condensation: 92 lb/hr', 'Overall heat transfer coefficient: 978.97 Btu/hr-ft^2-°F, Total rate of heat transfer: 123,021 Btu/hr, Total rate of condensation: 94.3 lb/hr', 'Overall heat transfer coefficient: 900 Btu/hr-ft^2-°F, Total rate of heat transfer: 120,000 Btu/hr, Total rate of condensation: 90 lb/hr', 'Overall heat transfer coefficient: 1050 Btu/hr-ft^2-°F, Total rate of heat transfer: 125,000 Btu/hr, Total rate of condensation: 95 lb/hr', 'Overall heat transfer coefficient: 850 Btu/hr-ft^2-°F, Total rate of heat transfer: 110,000 Btu/hr, Total rate of condensation: 85 lb/hr', 'Overall heat transfer coefficient: 1150 Btu/hr-ft^2-°F, Total rate of heat transfer: 135,000 Btu/hr, Total rate of condensation: 103 lb/hr', 'Overall heat transfer coefficient: 950 Btu/hr-ft^2-°F, Total rate of heat transfer: 117,500 Btu/hr, Total rate of condensation: 89 lb/hr']\",\"question\":\"Consider a vertical cylinder which has an outside diameter of 1.0 ft and is 2.0 ft long. Steam is condensing on the outer surface. The temperature of the outer surface is maintained at 85°F with cooling water inside the cylinder. Determine a) the overall heat transfer coefficient, b) the total rate of heat transfer, and c) the total rate of condensation. The saturation temperature is 105°F.\",\"src\":\"stemez-TransportPhenomena\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}