{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"38b20f31-d911-5439-947d-8ad13b39e91b","task_key":"default--test--4193","task_revision_id":"1","upstream_id":"4193","short_description":"A common rocket propellant is a mixture of one part liquid hydrazine (N_2H_4) as…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['- 120 Kcal/mole', '12 Kcal/mole', '- 57.8 Kcal/mole', '- 151 Kcal/mole', '33.5 Kcal/mole', '- 75 Kcal/mole', '- 46 Kcal/mole', '97.3 Kcal/mole', '62.1 Kcal/mole', '- 200 Kcal/mole']\",\"question\":\"A common rocket propellant is a mixture of one part liquid hydrazine (N_2H_4) as fuel and two parts liquid hydrogen peroxide (H_2O_2) as oxidizer. These reactants are hypergolic, that is, they ignite on contact. The reaction proceeds according to the equation N_2H_4(l) + 2H_2O_2 (l) \\\\rightarrow N_2(g) + 4H_2O(g). If reactants are mixed at 25°C, what is the heat of reaction?\",\"src\":\"stemez-Chemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}