{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9a4fd09a-268a-588a-bf32-e6ab4dafcc0a","task_key":"default--test--3979","task_revision_id":"1","upstream_id":"3979","short_description":"Without Catalyst(k), sec^-1 With Catalyst(k_c), sec^-1 T_1 = 473°K 1.76 × 10^-2…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['H = 19.6 kcal/mole, 13.4 kcal/mole; S = 34.9eu, 33.4eu', 'H = 23.5 kcal/mole, 16.2 kcal/mole; S = 37.1eu, 36.5eu', 'H = 18.2 kcal/mole, 12.8 kcal/mole; S = 33.3eu, 32.7eu', 'H = 20.6 kcal/mole, 14.4 kcal/mole; S = 35.5eu, 34.0eu', 'H = 17.8 kcal/mole, 11.9 kcal/mole; S = 32.8eu, 31.2eu', 'H = 25.0 kcal/mole, 18.0 kcal/mole; S = 39.2eu, 38.6eu', 'H = 24.3 kcal/mole, 17.1 kcal/mole; S = 38.0eu, 37.4eu', 'H = 19.2 kcal/mole, 13.7 kcal/mole; S = 33.9eu, 33.3eu', 'H = 22.4 kcal/mole, 15.6 kcal/mole; S = 36.7eu, 35.2eu', 'H = 21.0 kcal/mole, 15.0 kcal/mole; S = 34.0eu, 32.5eu']\",\"question\":\"Without Catalyst(k), sec^-1 With Catalyst(k_c), sec^-1 T_1 = 473°K 1.76 × 10^-2 6.10 T_2 = 573°K 0.804 88.1 The reaction rate of a first-order reaction at a con-stant pressure of 1atmis shown in the table above. Cal-culate the value of H and S° with and without catalyst, assuming that they do not change with temperature.\",\"src\":\"stemez-PhysicalChemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}