{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bac7e606-aca5-5ae7-9295-94d7380a4968","task_key":"default--test--4473","task_revision_id":"1","upstream_id":"4473","short_description":"One of the two most important uses of ammonia is as a reagent in the first step…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['K = {[NH_3]^4 [O_2]^5} / {[NO]^4 [H_2O]^6 }', 'K = {[O_2]^5} / { [NO]^4 [NH_3]^4 [H_2O]^6}', 'K = {[NO]^4 [H_2O]^6 } / { [NH_3]^4 [O_2]^5}', 'K = {[NO]^6 [H_2O]^4} / { [NH_3]^5 [O_2]^4}', 'K = {[NO]^4 [H_2O]^6 [NH_3]^4} / {[O_2]^5}', 'K = {[NH_3]^4 [O_2]^5 [H_2O]^6} / {[NO]^4}', 'K = {[NO]^4 [NH_3]^4} / { [H_2O]^6 [O_2]^5}', 'K = {[NH_3]^5 [O_2]^4} / { [NO]^6 [H_2O]^4}', 'K = {[NO]^4} / { [NH_3]^4 [O_2]^5}', 'K = {[NO]^4} / { [NH_3]^4 [H_2O]^6}']\",\"question\":\"One of the two most important uses of ammonia is as a reagent in the first step of theOsfwaldprocess, a synthetic route for the production of nitric acid. This first step proceeds according to the equation 4NH_3(g) + 50_2(g) \\\\rightleftarrows 4N0(g) + 6H_20(g) . What is the expression for the equilibrium constant of this reaction?\",\"src\":\"stemez-Chemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}