{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6a6390cf-7c5b-51d3-b14e-a32e4c345daf","task_key":"default--test--12105","task_revision_id":"1","upstream_id":"12105","short_description":"The shaft of a centrifugal pump is supported by a 180° centralpartial journal…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['165°F, 0.088', '145°F, 0.115', '140°F, 0.120', '150°F, 0.110', '160°F, 0.0943', '170°F, 0.085', '175°F, 0.080', '180°F, 0.105', '190°F, 0.075', '155°F, 0.099']\",\"question\":\"The shaft of a centrifugal pump is supported by a 180° centralpartial journal bearing 3 in. in diameter and 6 in. long. The clearance between the shaft and the bearing is 0.003 in. For lubrication SAE 20 oil is used and the minimum oil thicknessis 0.002 in. The shaft rotates at 1000 rpm and the bearingis subjected to a pressure of 50 psi based on the projectedarea of the journal. Evaluate the average temperatureof the oil film and the power developed due to friction.\",\"src\":\"stemez-MachineDesign\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}