{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"51bbd447-6435-5447-b36c-c5e3185fe8cb","task_key":"default--test--11983","task_revision_id":"1","upstream_id":"11983","short_description":"Propane burns in dry 125 percent theoretical air (21% O_2, 79% N_2) and the…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['Dew Point: 133F, Mole Fractions: CO2: 0.097, H2O: 0.123, O2: 0.042, N2: 0.738', 'Dew Point: 138F, Mole Fractions: CO2: 0.094, H2O: 0.126, O2: 0.04, N2: 0.74', 'Dew Point: 110F, Mole Fractions: CO2: 0.1, H2O: 0.14, O2: 0.055, N2: 0.705', 'Dew Point: 115F, Mole Fractions: CO2: 0.105, H2O: 0.11, O2: 0.06, N2: 0.725', 'Dew Point: 142F, Mole Fractions: CO2: 0.088, H2O: 0.132, O2: 0.035, N2: 0.745', 'Dew Point: 125F, Mole Fractions: CO2: 0.092, H2O: 0.117, O2: 0.048, N2: 0.743', 'Dew Point: 120F, Mole Fractions: CO2: 0.1, H2O: 0.13, O2: 0.05, N2: 0.75', 'Dew Point: 145F, Mole Fractions: CO2: 0.09, H2O: 0.12, O2: 0.03, N2: 0.76', 'Dew Point: 150F, Mole Fractions: CO2: 0.085, H2O: 0.135, O2: 0.025, N2: 0.755', 'Dew Point: 130F, Mole Fractions: CO2: 0.095, H2O: 0.125, O2: 0.045, N2: 0.735']\",\"question\":\"Propane burns in dry 125 percent theoretical air (21% O_2, 79% N_2) and the reaction is given by: C_3H_8 + 5O_2 + 18.8N_2 \\\\rightarrow 3CO_2 + 4H_2O + 18.8N_2 Calculate the dew point and the mole fractions of the combustionproducts when the air is at 1atmpressure.\",\"src\":\"stemez-Thermodynamics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}