{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3a2781a7-ebf6-517b-a0ea-7b9e04e06b64","task_key":"default--test--11507","task_revision_id":"1","upstream_id":"11507","short_description":"Superheated steam at 330psiaand 600°F, is flowing through a nozzle at a rate of…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['Exit jet velocity: 4100 ft/sec, Throat area: 0.83 in^2, Exit area: 9.3 in^2', 'Exit jet velocity: 3600 ft/sec, Throat area: 0.76 in^2, Exit area: 8.6 in^2', 'Exit jet velocity: 4000 ft/sec, Throat area: 0.8 in^2, Exit area: 9 in^2', 'Exit jet velocity: 3900 ft/sec, Throat area: 0.80 in^2, Exit area: 9.1 in^2', 'Exit jet velocity: 3697 ft/sec, Throat area: 0.772 in^2, Exit area: 8.784 in^2', 'Exit jet velocity: 3750 ft/sec, Throat area: 0.79 in^2, Exit area: 9 in^2', 'Exit jet velocity: 4200 ft/sec, Throat area: 0.85 in^2, Exit area: 9.5 in^2', 'Exit jet velocity: 3450 ft/sec, Throat area: 0.74 in^2, Exit area: 8.3 in^2', 'Exit jet velocity: 3800 ft/sec, Throat area: 0.78 in^2, Exit area: 8.9 in^2', 'Exit jet velocity: 3500 ft/sec, Throat area: 0.75 in^2, Exit area: 8.5 in^2']\",\"question\":\"Superheated steam at 330psiaand 600°F, is flowing through a nozzle at a rate of 12,000 lb/hr. The final pressure at the exit is 5psia. The velocity coefficient and the discharge coefficients are 0.92 and 0.95 respectively. Calculate a) the exit jet velocity and b) the areas at the throat and the exit.\",\"src\":\"stemez-Thermodynamics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}