{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7af64b90-3a77-5681-adc0-b16fa5163f33","task_key":"default--test--10273","task_revision_id":"1","upstream_id":"10273","short_description":"A heavy object can sink into the ground during an earthquake if the shaking…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['1.4 $10^3 \\\\\\\\mathrm{~kg} / \\\\\\\\mathrm{m}^3$', '1.2 $10^3 \\\\\\\\mathrm{~kg} / \\\\\\\\mathrm{m}^3$', '3.0 $10^3 \\\\\\\\mathrm{~kg} / \\\\\\\\mathrm{m}^3$', '1.6 $10^3 \\\\\\\\mathrm{~kg} / \\\\\\\\mathrm{m}^3$', '2.4 $10^3 \\\\\\\\mathrm{~kg} / \\\\\\\\mathrm{m}^3$', '1.8 $10^3 \\\\\\\\mathrm{~kg} / \\\\\\\\mathrm{m}^3$', '2.8 $10^3 \\\\\\\\mathrm{~kg} / \\\\\\\\mathrm{m}^3$', '2.2 $10^3 \\\\\\\\mathrm{~kg} / \\\\\\\\mathrm{m}^3$', '1.0 $10^3 \\\\\\\\mathrm{~kg} / \\\\\\\\mathrm{m}^3$', '2.6 $10^3 \\\\\\\\mathrm{~kg} / \\\\\\\\mathrm{m}^3$']\",\"question\":\"A heavy object can sink into the ground during an earthquake if the shaking causes the ground to undergo liquefaction, in which the soil grains experience little friction as they slide over one another. The ground is then effectively quicksand. The possibility of liquefaction in sandy ground can be predicted in terms of the void ratio $e$ for a sample of the ground:\\n$$\\ne=\\\\frac{V_{\\\\text {voids }}}{V_{\\\\text {grains }}} .\\n$$\\nHere, $V_{\\\\text {grains }}$ is the total volume of the sand grains in the sample and $V_{\\\\text {voids }}$ is the total volume between the grains (in the voids). If $e$ exceeds a critical value of 0.80 , liquefaction can occur during an earthquake. What is the corresponding sand density $\\\\rho_{\\\\text {sand }}$ ? Solid silicon dioxide (the primary component of sand) has a density of $\\\\rho_{\\\\mathrm{SiO}_2}=2.600 \\\\times 10^3 \\\\mathrm{~kg} / \\\\mathrm{m}^3$.\",\"src\":\"scibench-fund\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}