{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c3094a8d-094d-5160-b6c4-643c8917ae3e","task_key":"default--test--4476","task_revision_id":"1","upstream_id":"4476","short_description":"Given the reaction A + B \\rightleftarrows C + D, find the equilibrium constant…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['equilibrium constant is 7.00, concentration of A and B is 0.45M, and of C and D is 1.55M', 'equilibrium constant is 6.23, concentration of A and B is 0.5M, and of C and D is 1.5M', 'equilibrium constant is 4.65, concentration of A and B is 0.7M, and of C and D is 1.3M', 'equilibrium constant is 4.00, concentration of A and B is 0.75M, and of C and D is 1.25M', 'equilibrium constant is 6.67, concentration of A and B is 0.55M, and of C and D is 1.45M', 'equilibrium constant is 5.44, concentration of A and B is 0.6M, and of C and D is 1.4M', 'equilibrium constant is 8.34, concentration of A and B is 0.40M, and of C and D is 1.60M', 'equilibrium constant is 3.00, concentration of A and B is 0.85M, and of C and D is 1.15M', 'equilibrium constant is 2.50, concentration of A and B is 0.65M, and of C and D is 1.35M', 'equilibrium constant is 3.76, concentration of A and B is 0.8M, and of C and D is 1.2M']\",\"question\":\"Given the reaction A + B \\\\rightleftarrows C + D, find the equilibrium constant for this reaction if .7 moles of C are formed when 1 mole of A and 1 mole of B are initially present. For this same equilibrium, find the equilibrium composition when 1 mole each of A, B, C, and D are initial-ly present.\",\"src\":\"stemez-Chemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}