{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a2f74b9b-01e3-5fa9-b7fa-3d3fbc7697de","task_key":"default--test--10215","task_revision_id":"1","upstream_id":"10215","short_description":"By definition, the electric displacement current through a surface S is…","config":"default","split":"test","body":"{\"category\":\"physics\",\"options\":\"['rate of change of the magnetic flux through S', 'electric flux through S', 'rate of change of the electric current through S', 'time integral of the magnetic flux through S', 'rate of change of the electric flux through S', 'electric current through S', 'magnetic flux through S', 'time integral of the electric flux through S', 'rate of change of the magnetic current through S', 'magnetic current through S']\",\"question\":\"By definition, the electric displacement current through a surface S is proportional to the\",\"src\":\"ori_mmlu-college_physics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}