{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8c85db28-3b6c-554e-926c-ea8435b91240","task_key":"default--test--3886","task_revision_id":"1","upstream_id":"3886","short_description":"Twoequimolarsolutions A and B with equal volume of solutions are mixed together…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['a) 6.26%, b) 14.3%, c) 0%', 'a) 3.125%, b) 10.8%, c) 18.75%', 'a) 5%, b) 15%, c) 25%', 'a) 11%, b) 22%, c) 44%', 'a) 4.1%, b) 13.5%, c) 27%', 'a) 12.5%, b) 25%, c) 50%', 'a) 8.33%, b) 12.5%, c) 37.5%', 'a) 7.5%, b) 15%, c) 22.5%', 'a) 9.375%, b) 18.75%, c) 37.5%', 'a) 10%, b) 20%, c) 30%']\",\"question\":\"Twoequimolarsolutions A and B with equal volume of solutions are mixed together and the reaction A + B = C takes place. After 1 hr, A is 75% reacted. Calculate how much of A will not react after 2 hrs if a) the reaction is first order in A and zero order in B. b) the reaction is first order in both A and B and c) the reaction is zero order in both A and B.\",\"src\":\"stemez-PhysicalChemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}