{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c559db7e-6e2c-5ad9-9121-1bfdf9f2d623","task_key":"default--test--4305","task_revision_id":"1","upstream_id":"4305","short_description":"The equation for the burning of naphthalene is C_10H_8 (s) + 12O_2(g)…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['- 1200 Kcal/mole, - 1150 Kcal/mole', '- 1250 Kcal/mole, - 1230 Kcal/mole', '- 1227.9 Kcal/mole, - 1185.5 Kcal/mole', '- 1226.7 Kcal/mole, - 1185.5 Kcal/mole', '- 1300 Kcal/mole, - 1200 Kcal/mole', '- 1235 Kcal/mole, - 1210 Kcal/mole', '- 1226.7 Kcal/mole, - 1200 Kcal/mole', '- 1190 Kcal/mole, - 1150 Kcal/mole', '- 1227.9 Kcal/mole, - 1200 Kcal/mole', '- 1280 Kcal/mole, - 1250 Kcal/mole']\",\"question\":\"The equation for the burning of naphthalene is C_10H_8 (s) + 12O_2(g) \\\\rightarrow1OCO_2 + 4H_2 O (l). For every mole of C_10H_8 burned, - 1226.7 Kcal is evolved at 25° in a fixed- volume combustion chamber. ∆H° for H_2O(l) = - 64.4 Kcal/mole and H_2O (g) = - 57.8 Kcal/mole. Calculate (a) the heat of reaction at constant temperature and (b) ∆H for the case where all of the H_2O is gaseous.\",\"src\":\"stemez-Chemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}