{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9421b4a6-8417-57e9-8610-982aa15b81fe","task_key":"default--test--3996","task_revision_id":"1","upstream_id":"3996","short_description":"Frozen-core $\\mathrm{SCF} / \\mathrm{DZP}$ and CI-SD/DZP calculations on…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['0.7421', '1.0678', '0.8552', '1.0125', '0.8117', '0.9315', '0.8923', '0.9731', '0.6284', '1.1003']\",\"question\":\"Frozen-core $\\\\mathrm{SCF} / \\\\mathrm{DZP}$ and CI-SD/DZP calculations on $\\\\mathrm{H}_2 \\\\mathrm{O}$ at its equilibrium geometry gave energies of -76.040542 and -76.243772 hartrees. Application of the Davidson correction brought the energy to -76.254549 hartrees. Find the coefficient of $\\\\Phi_0$ in the normalized CI-SD wave function.\",\"src\":\"scibench-quan\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}