{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c6a41006-3ef8-51c9-90e3-d9dff40e9858","task_key":"default--test--9460","task_revision_id":"1","upstream_id":"9460","short_description":"Earth's atmosphere is constantly bombarded by cosmic ray protons that originate…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['$145$ $\\\\\\\\mathrm{~mA}$', '$110$ $\\\\\\\\mathrm{~mA}$', '$175$ $\\\\\\\\mathrm{~mA}$', '$250$ $\\\\\\\\mathrm{~mA}$', '$98$ $\\\\\\\\mathrm{~mA}$', '$122$ $\\\\\\\\mathrm{~mA}$', '$200$ $\\\\\\\\mathrm{~mA}$', '$65$ $\\\\\\\\mathrm{~mA}$', '$150$ $\\\\\\\\mathrm{~mA}$', '$80$ $\\\\\\\\mathrm{~mA}$']\",\"question\":\"Earth's atmosphere is constantly bombarded by cosmic ray protons that originate somewhere in space. If the protons all passed through the atmosphere, each square meter of Earth's surface would intercept protons at the average rate of 1500 protons per second. What would be the electric current intercepted by the total surface area of the planet?\",\"src\":\"scibench-fund\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}