{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e8dde239-781b-562c-a1f9-43c659650c61","task_key":"default--test--12137","task_revision_id":"1","upstream_id":"12137","short_description":"Water enters a reactor through a length of pipe in which the necessarypreheating…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['(a) 2 m, (b) 375 K', '(a) 2.8 m, (b) 355 K', '(a) 3 m, (b) 370 K', '(a) 1.5 m, (b) 375 K', '(a) 1.8 m, (b) 360 K', '(a) 3.5 m, (b) 372 K', '(a) 2.5 m, (b) 360 K', '(a) 1.2 m, (b) 365 K', '(a) 4 m, (b) 380 K', '(a) 2.32 m, (b) 367.07 K']\",\"question\":\"Water enters a reactor through a length of pipe in which the necessarypreheating is accomplished. The reactor has a maximumpower rating of 150 W per meter of pipe, and its operatingtemperature is 350°K. The flow is measured at 5 kg/hr, and it enters the pipe at a mean bulk temperature of 290°K.If the internal diameter of the pipe is 0.005 m, calculate (a)thelength of pipe over which the necessary heat transfer maybe accomplished, and (b)themaximum exit temperature of the water.\",\"src\":\"stemez-Thermodynamics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}