{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8452edfa-0300-5115-922f-0808aa1938fe","task_key":"default--test--11750","task_revision_id":"1","upstream_id":"11750","short_description":"Assuming steam to be an ideal gas, obtain its specific volume and density at a…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['v = 6.94 (ft^3 / lbm), ρ = 0.130 (lbm / ft^3)', 'v = 6.34 (ft^3 / lbm), ρ = 0.136 (lbm / ft^3)', 'v = 5.34 (ft^3 / lbm), ρ = 0.165 (lbm / ft^3)', 'v = 7.24 (ft^3 / lbm), ρ = 0.136 (lbm / ft^3)', 'v = 6.84 (ft^3 / lbm), ρ = 0.150 (lbm / ft^3)', 'v = 7.34 (ft^3 / lbm), ρ = 0.146 (lbm / ft^3)', 'v = 8.34 (ft^3 / lbm), ρ = 0.120 (lbm / ft^3)', 'v = 7.34 (ft^3 / lbm), ρ = 0.136 (lbm / ft^3)', 'v = 7.54 (ft^3 / lbm), ρ = 0.142 (lbm / ft^3)', 'v = 7.44 (ft^3 / lbm), ρ = 0.128 (lbm / ft^3)']\",\"question\":\"Assuming steam to be an ideal gas, obtain its specific volume and density at a pressure of 90 lb/in^2 and a temperature of 650°F. Table Gas Chemical symbol Molecular weight Gas constant ft-lb/lb R Specific heat B/lb Specific heat ratio M R C_V C_P k Air 28.95 53.35 0.172 0.240 1.40 Carbon dioxide CO_2 44.00 35.13 0.160 0.205 1.28 Hydrogen H_2 2.016 766.80 2.44 3.42 1.40 Nitrogen N_2 28.02 55.16 0.176 0.247 1.40 Oxygen O_2 32.0 48.31 0.155 0.217 1.40 Steam H_2O 18.016 85.81 0.36 0.46 1.28\",\"src\":\"stemez-Thermodynamics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}