{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c3789422-a939-54b6-a1b5-2112a536c7f7","task_key":"default--test--3650","task_revision_id":"1","upstream_id":"3650","short_description":"Assume all gases are perfect unless stated otherwise. Note that 1 atm = 1.013 25…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['-2.15$\\\\\\\\text{kJ}$', '+4.85$\\\\\\\\text{kJ}$', '+3.60$\\\\\\\\text{kJ}$ ', '+2.10$\\\\\\\\text{kJ}$', '+5.30$\\\\\\\\text{kJ}$', '+1.75$\\\\\\\\text{kJ}$', '-3.75$\\\\\\\\text{kJ}$', '-0.95$\\\\\\\\text{kJ}$', '+6.25$\\\\\\\\text{kJ}$', '-1.25$\\\\\\\\text{kJ}$']\",\"question\":\"Assume all gases are perfect unless stated otherwise. Note that 1 atm = 1.013 25 bar. Unless otherwise stated, thermochemical data are for 298.15 K. Take nitrogen to be a van der Waals gas with $a=1.352 \\\\mathrm{dm}^6 \\\\mathrm{~atm} \\\\mathrm{\\\\textrm {mol } ^ { - 2 }}$ and $b=0.0387 \\\\mathrm{dm}^3 \\\\mathrm{~mol}^{-1}$, and calculate $\\\\Delta H_{\\\\mathrm{m}}$ when the pressure on the gas is decreased from $500 \\\\mathrm{~atm}$ to $1.00 \\\\mathrm{~atm}$ at $300 \\\\mathrm{~K}$. For a van der Waals gas, $\\\\mu=\\\\{(2 a / R T)-b\\\\} / C_{p, \\\\mathrm{~m}}$. Assume $C_{p, \\\\mathrm{~m}}=\\\\frac{7}{2} R$.\",\"src\":\"scibench-atkins\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}