{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d13224fa-d110-528c-8a3c-eff28f2a6071","task_key":"default--test--12138","task_revision_id":"1","upstream_id":"12138","short_description":"Determine the equation of state for a certain hypothetical gas whose thermal…","config":"default","split":"test","body":"{\"category\":\"engineering\",\"options\":\"['P^(k)1V = k [T^{(C)P/(C)V} + k_1]', 'P^(k)2V = k [T^{(C)V/(C)P} + k_2]', 'PV = k exp [k_1 T^{(C)P/(C)V} + k_2]', 'P^(k)1V = k exp [k_1 T^{(C)P/(C)V}]', 'PV^(k)2 = k exp [k_1 T^{(C)V/(C)P}]', 'P^(k)2V = k exp [k_2 T^{(C)P/(C)V}]', 'PV = k exp [k_2 T^{(C)P/(C)V - 1}]', 'P^(k)1V = k exp [k_2 T^{(C)V/(C)P}]', 'P^(k)2V = k exp [k_1 T^{(C)P/(C)V}]']\",\"question\":\"Determine the equation of state for a certain hypothetical gas whose thermal coefficient of expansion is \\\\alpha = (1 / V)(\\\\partialV / \\\\partialT)_P = k_1(C_P / C_V)T^{(C)P/(C)V}-1 and the coefficient of isothermal compressibility is \\\\beta = - (1 / V)(\\\\partialV / \\\\partialT)_P = (k_2 / P). In this problem, assume that C_P, C_V, k_1 and k_2 are constants.\",\"src\":\"stemez-Thermodynamics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}