{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b08f433d-661b-5941-8b30-3f654d27610c","task_key":"default--test--12018","task_revision_id":"1","upstream_id":"12018","short_description":"A thick brick wall has a surface which experiences a daily temperature variation…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['(a) 6.37 hrs, (b) 11.74°F, (c) 13.84°F, (d) 700 Btu/hrft^2', '(a) 7.37 hrs, (b) 6.50°F, (c) 5.50°F, (d) 530 Btu/hrft^2', '(a) 4.00 hrs, (b) 8.50°F, (c) 9.50°F, (d) 550 Btu/hrft^2', '(a) 4.37 hrs, (b) 12.74°F, (c) 11.84°F, (d) 594 Btu/hrft^2', '(a) 5.37 hrs, (b) 10.74°F, (c) 10.84°F, (d) 500 Btu/hrft^2', '(a) 3.00 hrs, (b) 13.74°F, (c) 14.84°F, (d) 620 Btu/hrft^2', '(a) 6.00 hrs, (b) 7.74°F, (c) 6.84°F, (d) 560 Btu/hrft^2', '(a) 2.37 hrs, (b) 14.50°F, (c) 13.00°F, (d) 600 Btu/hrft^2', '(a) 3.37 hrs, (b) 15.74°F, (c) 12.84°F, (d) 650 Btu/hrft^2', '(a) 5.00 hrs, (b) 9.74°F, (c) 8.84°F, (d) 580 Btu/hrft^2']\",\"question\":\"A thick brick wall has a surface which experiences a daily temperature variation from 50°F to 130°F. The properties of the brick are: k = 0.4 Btu/hr. ft.^2(°F/ft) C_p = 0.3 Btu/lb. °F \\\\rho = 120 lb/ft^3 \\\\alpha = (k / c\\\\rho) = 0.01111 ft^2/hr Assume the variation to be cosine in nature, and the cement between the bricks has the same properties as of the bricks. Find (a) the temperature lag at a point 4 in. below the surface; (b) the amplitude at this depth; (c) the temperature deviation from the mean after 3 hours; (d) the heat flow during the half period.\",\"src\":\"stemez-HeatTransfer\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}