{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f0f26f98-ef68-5566-abda-eaa225dff5ba","task_key":"default--test--3578","task_revision_id":"1","upstream_id":"3578","short_description":"The vapor pressures of pure benzene and toluene at 60°C are 385 and 139Torr,…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['P_benzene= 148.0Torr, P_toluene= 89.4Torr, P_total= 237.4Torr, X_toluene,vap= 0.377', 'P_benzene= 151.0Torr, P_toluene= 88.4Torr, P_total= 239.4Torr, X_toluene,vap= 0.369', 'P_benzene= 152.0Torr, P_toluene= 87.4Torr, P_total= 240.4Torr, X_toluene,vap= 0.364', 'P_benzene= 158.0Torr, P_toluene= 85.4Torr, P_total= 243.4Torr, X_toluene,vap= 0.355', 'P_benzene= 150.0Torr, P_toluene= 80.4Torr, P_total= 230.4Torr, X_toluene,vap= 0.341', 'P_benzene= 157.0Torr, P_toluene= 82.4Torr, P_total= 239.4Torr, X_toluene,vap= 0.344', 'P_benzene= 160.0Torr, P_toluene= 90.4Torr, P_total= 250.4Torr, X_toluene,vap= 0.361', 'P_benzene= 162.0Torr, P_toluene= 76.4Torr, P_total= 238.4Torr, X_toluene,vap= 0.321', 'P_benzene= 154.0Torr, P_toluene= 83.4Torr, P_total= 237.4Torr, X_toluene,vap= 0.351', 'P_benzene= 145.0Torr, P_toluene= 94.4Torr, P_total= 239.4Torr, X_toluene,vap= 0.394']\",\"question\":\"The vapor pressures of pure benzene and toluene at 60°C are 385 and 139Torr, respectively. Calculate (a) the partial pressures of benzene and toluene, (b) the total vapor pressure of the solution, and (c) the mole fraction of toluene in the vapor above a solution with 0.60 mole fraction toluene.\",\"src\":\"stemez-Chemistry\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}