{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"98b294b8-bdfd-587a-bbb0-92e2a8ba6dd7","task_key":"default--test--3907","task_revision_id":"1","upstream_id":"3907","short_description":"1.7(a) In an attempt to determine an accurate value of the gas constant, $R$, a…","config":"default","split":"test","body":"{\"category\":\"chemistry\",\"options\":\"['7.2084$\\\\\\\\mathrm{JK}^{-1} \\\\\\\\mathrm{~mol}^{-1}$', '7.9876$\\\\\\\\mathrm{JK}^{-1} \\\\\\\\mathrm{~mol}^{-1}$', '8.8147$\\\\\\\\mathrm{JK}^{-1} \\\\\\\\mathrm{~mol}^{-1}$', '8.2064$\\\\\\\\mathrm{JK}^{-1} \\\\\\\\mathrm{~mol}^{-1}$', '8.5000$\\\\\\\\mathrm{JK}^{-1} \\\\\\\\mathrm{~mol}^{-1}$', '8.9999$\\\\\\\\mathrm{JK}^{-1} \\\\\\\\mathrm{~mol}^{-1}$', '9.0823$\\\\\\\\mathrm{JK}^{-1} \\\\\\\\mathrm{~mol}^{-1}$', '7.3147$\\\\\\\\mathrm{JK}^{-1} \\\\\\\\mathrm{~mol}^{-1}$', '8.3147$\\\\\\\\mathrm{JK}^{-1} \\\\\\\\mathrm{~mol}^{-1}$', '9.3147$\\\\\\\\mathrm{JK}^{-1} \\\\\\\\mathrm{~mol}^{-1}$']\",\"question\":\"1.7(a) In an attempt to determine an accurate value of the gas constant, $R$, a student heated a container of volume $20.000 \\\\mathrm{dm}^3$ filled with $0.25132 \\\\mathrm{g}$ of helium gas to $500^{\\\\circ} \\\\mathrm{C}$ and measured the pressure as $206.402 \\\\mathrm{cm}$ of water in a manometer at $25^{\\\\circ} \\\\mathrm{C}$. Calculate the value of $R$ from these data. (The density of water at $25^{\\\\circ} \\\\mathrm{C}$ is $0.99707 \\\\mathrm{g} \\\\mathrm{cm}^{-3}$; a manometer consists of a U-shaped tube containing a liquid. One side is connected to the apparatus and the other is open to the atmosphere. The pressure inside the apparatus is then determined from the difference in heights of the liquid.)\",\"src\":\"scibench-atkins\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}