{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"09c34e22-7642-5399-b5d4-be3a49b4f04c","task_key":"default--test--12042","task_revision_id":"1","upstream_id":"12042","short_description":"A polished stainless steel surface is electrically heated from the bottom to…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['15000 Btu/hr-ft^2', '30000 Btu/hr-ft^2', '22000 Btu/hr-ft^2', '5000 Btu/hr-ft^2', '16000 Btu/hr-ft^2', '12500 Btu/hr-ft^2', '9500 Btu/hr-ft^2', '10888.25 Btu/hr-ft^2', '7000 Btu/hr-ft^2', '20000 Btu/hr-ft^2']\",\"question\":\"A polished stainless steel surface is electrically heated from the bottom to boil water at atmospheric pressure. If the surface temperature is 230 F, calculate the heat flux from the surface to the water and compare this value with the critical heat flux of nucleate boiling.\",\"src\":\"stemez-TransportPhenomena\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}