{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"04e7351c-6a0c-5508-9fee-9219e7fd6443","task_key":"default--test--11800","task_revision_id":"1","upstream_id":"11800","short_description":"A copper pipe (1 in. O.D., 0.88 in. I.D. and k = 220 Btu/hr-ft-°F) carries…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['65 hours', '77 hours', '70 hours', '52 hours', '84 hours', '48 hours', '58 hours', '75 hours', '61 hours', '90 hours']\",\"question\":\"A copper pipe (1 in. O.D., 0.88 in. I.D. and k = 220 Btu/hr-ft-°F) carries process steam 212°F through a room at 60°F. The heating cost of steam is 0.05 cents/ Btu. The pipe is insulated with 85% magnesia (0.57 in. thick and k = 0.038 Btu/hr-ft-°F) at a cost of $3.25 per foot. Estimate the payback period of insulation cost. Assume a constant fluid film resistance (0.95 hr-ft-°F/Btu) and neglect outer surface film resistance.\",\"src\":\"stemez-TransportPhenomena\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}