{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e260ce24-85e7-5ba6-9aeb-595a703fd29f","task_key":"default--test--11417","task_revision_id":"1","upstream_id":"11417","short_description":"Air at one atm. and 90°F moves at 140 ft/sec across a flat plate of length 3 ft.…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['18,252 Btu/hr', '11,200 Btu/hr', '17,100 Btu/hr', '20,450 Btu/hr', '15,336 Btu/hr', '13,750 Btu/hr', '9,500 Btu/hr', '2632 Btu/hr', '12,704 Btu/hr', '22,675 Btu/hr']\",\"question\":\"Air at one atm. and 90°F moves at 140 ft/sec across a flat plate of length 3 ft. The temperature at the sur-face of the plate is 450°F. For a 1 ft. width, deter-mine the heat loss from the entire plate, and also the heat loss from the laminar and turbulent sections of the boundary layer. Then, assuming that the boundary layer is completely turbulent, calculate the heat loss.\",\"src\":\"stemez-TransportPhenomena\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}