{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"94b5c459-56a1-5559-acf8-bffc0a0a4e73","task_key":"default--test--9136","task_revision_id":"1","upstream_id":"9136","short_description":"A clown is juggling four balls simultaneously. Students use a video tape to…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['8.0 $\\\\\\\\mathrm{m} \\\\\\\\cdot \\\\\\\\mathrm{s}^{-1}$', '10.0 $\\\\\\\\mathrm{m} \\\\\\\\cdot \\\\\\\\mathrm{s}^{-1}$', '11.5 $\\\\\\\\mathrm{m} \\\\\\\\cdot \\\\\\\\mathrm{s}^{-1}$', '14.5 $\\\\\\\\mathrm{m} \\\\\\\\cdot \\\\\\\\mathrm{s}^{-1}$', '13.2$\\\\\\\\mathrm{~m} \\\\\\\\cdot \\\\\\\\mathrm{s}^{-1}$ ', '9.8 $\\\\\\\\mathrm{m} \\\\\\\\cdot \\\\\\\\mathrm{s}^{-1}$', '12.5 $\\\\\\\\mathrm{m} \\\\\\\\cdot \\\\\\\\mathrm{s}^{-1}$', '18.3 $\\\\\\\\mathrm{m} \\\\\\\\cdot \\\\\\\\mathrm{s}^{-1}$', '15.7 $\\\\\\\\mathrm{m} \\\\\\\\cdot \\\\\\\\mathrm{s}^{-1}$', '16.8 $\\\\\\\\mathrm{m} \\\\\\\\cdot \\\\\\\\mathrm{s}^{-1}$']\",\"question\":\"A clown is juggling four balls simultaneously. Students use a video tape to determine that it takes the clown $0.9 \\\\mathrm{~s}$ to cycle each ball through his hands (including catching, transferring, and throwing) and to be ready to catch the next ball. What is the minimum vertical speed the clown must throw up each ball?\\n\",\"src\":\"scibench-class\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}