{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"34e752a7-23b0-5007-85c3-53a109feb5d7","task_key":"default--test--3704","task_revision_id":"1","upstream_id":"3704","short_description":"For the reaction C(s) + 2 H_2O(g) = CO_2(g) + 2H_2(g) calculate \\DeltaH and…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['\\\\\\\\DeltaH = 24.2 kcal, \\\\\\\\DeltaE = 23.7 kcal', '\\\\\\\\DeltaH = 18.5 kcal, \\\\\\\\DeltaE = 19.0 kcal', '\\\\\\\\DeltaH = 22.5 kcal, \\\\\\\\DeltaE = 21.8 kcal', '\\\\\\\\DeltaH = 17.5 kcal, \\\\\\\\DeltaE = 18.1 kcal', '\\\\\\\\DeltaH = 19.2 kcal, \\\\\\\\DeltaE = 20.1 kcal', '\\\\\\\\DeltaH = 21.3 kcal, \\\\\\\\DeltaE = 20.7 kcal', '\\\\\\\\DeltaH = 20.7 kcal, \\\\\\\\DeltaE = 21.3 kcal', '\\\\\\\\DeltaH = 23.1 kcal, \\\\\\\\DeltaE = 22.4 kcal', '\\\\\\\\DeltaH = 19.8 kcal, \\\\\\\\DeltaE = 18.3 kcal', '\\\\\\\\DeltaH = 25.3 kcal, \\\\\\\\DeltaE = 24.6 kcal']\",\"question\":\"For the reaction C(s) + 2 H_2O(g) = CO_2(g) + 2H_2(g) calculate \\\\DeltaH and \\\\DeltaE at 25°C,given the following data: heat of formation at 25°C: H_2O(g) = - 57.8 kcal, CH_4(g) = - 17.9 kcal. Also, the heat of combustion of CH_4 at 25°C to CO_2 and H_2O(g) is - 192.2 kcal.\",\"src\":\"stemez-PhysicalChemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}