{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"457954ae-d13f-5801-abdf-d25d012de687","task_key":"default--test--12132","task_revision_id":"1","upstream_id":"12132","short_description":"The combustion equation for octane burning in theoretical air (21% O_2 and 79%…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['1,100°C', '1,450°C', '1,171°C', '1,610°C', '1,327°C', '1,500°C', '1,233°C', '1,050°C', '1,300°C', '1,393°C']\",\"question\":\"The combustion equation for octane burning in theoretical air (21% O_2 and 79% N_2) is C_8H_18(1) + 12.5O_2 + 12.5(3.76)N_2 \\\\rightarrow 8CO_2 + 9H_2O + 47N_2 Determine the adiabatic flame temperature for liquid octane burningwith 200 percent theoretical air at 25°C. Use the followingdata to solve the problem: h^0_f = Standard enthalpy of formation (allenthalpies are in kcal/mol) DATA SPECIES h°_f (Kcal/mol) h25°C H139°C H117 / °C h838°C C_8H_18 - 27093.8 --- --- --- --- C0_2 - 42661.1 1015.6 8771 7355 5297 H_2O - 26218.1 1075.5 7153 6051 4395 N_2 0 940.0 5736 4893 3663 O_2 0 938.7 6002 5118 3821\",\"src\":\"stemez-Thermodynamics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}