{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fdd07e7c-b618-5cb1-a80b-0560d9e2e8a1","task_key":"default--test--11674","task_revision_id":"1","upstream_id":"11674","short_description":"Determine (a) the specific speed of a pump that is to deliver 2,000gpmagainst a…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['(a) 610, (b) 3200gpm and 480ft, (c) 610, (d) 390 rpm', '(a) 650, (b) 4200gpm and 630ft, (c) 650, (d) 340 rpm', '(a) 600, (b) 3000gpm and 450ft, (c) 600, (d) 400 rpm', '(a) 640, (b) 3800gpm and 570ft, (c) 640, (d) 355 rpm', '(a) 625, (b) 3500gpm and 550ft, (c) 650, (d) 375 rpm', '(a) 630, (b) 4600gpm and 690ft, (c) 630, (d) 345 rpm', '(a) 675, (b) 5000gpm and 750ft, (c) 675, (d) 330 rpm', '(a) 650, (b) 4500gpm and 650ft, (c) 650, (d) 350 rpm', '(a) 590, (b) 2800gpm and 420ft, (c) 590, (d) 410 rpm', '(a) 625, (b) 4000gpm and 600ft, (c) 625, (d) 365 rpm']\",\"question\":\"Determine (a) the specific speed of a pump that is to deliver 2,000gpmagainst a head of 150 ft with arotativespeed of 600 rpm.(b) If therotativespeed were doubled, what would bethe flow rate and the head developed by the pump? Assume no change in efficiency. (c) The specific speed for theconditions given in (b). And (d) find the required operatingspeed of a two-stage pump to satisfy the requirementsin (a).\",\"src\":\"stemez-FluidMechanics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}