{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9695b2e6-9963-569e-b09c-b2b8cddc3b6d","task_key":"default--test--11564","task_revision_id":"1","upstream_id":"11564","short_description":"Oil is to be pumped at a rate of 1) 10 lb/sec, 2) 50 lb/sec through a horizontal…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['19.4 psi and 1.15 hp for 10 lb/sec, 370.2 psi and 82.1 hp for 50 lb/sec', '18.5 psi and 1.1 hp for 10 lb/sec, 360.5 psi and 75.5 hp for 50 lb/sec', '21.3 psi and 0.95 hp for 10 lb/sec, 378.1 psi and 83.5 hp for 50 lb/sec', '22.3 psi and 1.05 hp for 10 lb/sec, 385.1 psi and 90.5 hp for 50 lb/sec', '17.9 psi and 0.92 hp for 10 lb/sec, 355.8 psi and 79.8 hp for 50 lb/sec', '16.2 psi and 0.78 hp for 10 lb/sec, 365.9 psi and 77.2 hp for 50 lb/sec', '23.8 psi and 0.9 hp for 10 lb/sec, 390.3 psi and 88.7 hp for 50 lb/sec', '15.7 psi and 1.2 hp for 10 lb/sec, 380.2 psi and 85.6 hp for 50 lb/sec', '25.1 psi and 1.05 hp for 10 lb/sec, 400.7 psi and 95.4 hp for 50 lb/sec', '20.3 psi and 0.85 hp for 10 lb/sec, 375.1 psi and 80.5 hp for 50 lb/sec']\",\"question\":\"Oil is to be pumped at a rate of 1) 10 lb/sec, 2) 50 lb/sec through a horizontal pipe of 4 in.diaand 5280 ft length. Calculate the drop in pressure and the theoretical horse-power developed, if the oil density is 59.3 lb/ft^3 and the viscosity is 50 cp. For the case of turbulent flow, assume the Darcy friction factor to be 10 per cent higher than calculated for a smooth pipe.\",\"src\":\"stemez-TransportPhenomena\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}