{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f0b053b6-57b0-50fc-ae63-8732907d5379","task_key":"default--test--9232","task_revision_id":"1","upstream_id":"9232","short_description":"\"Top gun\" pilots have long worried about taking a turn too tightly. As a pilot's…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['95.67 $\\\\\\\\mathrm{m} / \\\\\\\\mathrm{s}^2$', '62.48 $\\\\\\\\mathrm{m} / \\\\\\\\mathrm{s}^2$', '83.81 $\\\\\\\\mathrm{m} / \\\\\\\\mathrm{s}^2$', '72.14 $\\\\\\\\mathrm{m} / \\\\\\\\mathrm{s}^2$', '110.87 $\\\\\\\\mathrm{m} / \\\\\\\\mathrm{s}^2$', '75.19 $\\\\\\\\mathrm{m} / \\\\\\\\mathrm{s}^2$', '100.56 $\\\\\\\\mathrm{m} / \\\\\\\\mathrm{s}^2$', '55.92 $\\\\\\\\mathrm{m} / \\\\\\\\mathrm{s}^2$', '90.43 $\\\\\\\\mathrm{m} / \\\\\\\\mathrm{s}^2$', '68.25 $\\\\\\\\mathrm{m} / \\\\\\\\mathrm{s}^2$']\",\"question\":\"\\\"Top gun\\\" pilots have long worried about taking a turn too tightly. As a pilot's body undergoes centripetal acceleration, with the head toward the center of curvature, the blood pressure in the brain decreases, leading to loss of brain function.\\nThere are several warning signs. When the centripetal acceleration is $2 g$ or $3 g$, the pilot feels heavy. At about $4 g$, the pilot's vision switches to black and white and narrows to \\\"tunnel vision.\\\" If that acceleration is sustained or increased, vision ceases and, soon after, the pilot is unconscious - a condition known as $g$-LOC for \\\" $g$-induced loss of consciousness.\\\"\\n\\nWhat is the magnitude of the acceleration, in $g$ units, of a pilot whose aircraft enters a horizontal circular turn with a velocity of $\\\\vec{v}_i=(400 \\\\hat{\\\\mathrm{i}}+500 \\\\hat{\\\\mathrm{j}}) \\\\mathrm{m} / \\\\mathrm{s}$ and $24.0 \\\\mathrm{~s}$ later leaves the turn with a velocity of $\\\\vec{v}_f=(-400 \\\\hat{\\\\mathrm{i}}-500 \\\\hat{\\\\mathrm{j}}) \\\\mathrm{m} / \\\\mathrm{s}$ ?\",\"src\":\"scibench-fund\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}