{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ecb2eaa3-6a32-590c-b639-72f5d0d05f7d","task_key":"default--test--11974","task_revision_id":"1","upstream_id":"11974","short_description":"A certainsteel containing 0.7 weight-percent carbon is in equilibriumwith a…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['The activity of the carbon in the steel is 0.47. The gas contains 90.6% CO and 9.4% CO2 (by volume).', 'The activity of the carbon in the steel is 0.65. The gas contains 88.6% CO and 11.4% CO2 (by volume).', 'The activity of the carbon in the steel is 0.48. The gas contains 93.6% CO and 6.4% CO2 (by volume).', 'The activity of the carbon in the steel is 0.60. The gas contains 96.6% CO and 3.4% CO2 (by volume).', 'The activity of the carbon in the steel is 0.51. The gas contains 94.6% CO and 5.4% CO2 (by volume).', 'The activity of the carbon in the steel is 0.75. The gas contains 85.6% CO and 14.4% CO2 (by volume).', 'The activity of the carbon in the steel is 0.55. The gas contains 92.6% CO and 7.4% CO2 (by volume).', 'The activity of the carbon in the steel is 0.58. The gas contains 89.6% CO and 10.4% CO2 (by volume).', 'The activity of the carbon in the steel is 0.68. The gas contains 91.6% CO and 8.4% CO2 (by volume).', 'The activity of the carbon in the steel is 0.42. The gas contains 97.6% CO and 2.4% CO2 (by volume).']\",\"question\":\"A certainsteel containing 0.7 weight-percent carbon is in equilibriumwith a methane-hydrogen gas mixture containing 99 percent hydrogen and 1 percent methane by volume at 1,173°K and 1 atm.Findthe activity of carbon in the steel andthe equilibrium volume percentages of a carbon monoxide-carbondioxide mixture at equilibrium with the steelat the same conditions. Use the following data to solve theproblem and assume all gases are ideal. Data For the reaction C(s, graphite)+2H_2(_g) \\\\rightleftharpoons CH_4(g) \\\\DeltaG^0 = - 21,600 + 26.2T cal For the reaction CO_2(_g) + C(s, graphite)\\\\rightleftharpoons 2CO_(g_) \\\\DeltaG^0 = 40,800 - 41.7T cal\",\"src\":\"stemez-Thermodynamics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}