{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"04ad5268-2c07-5985-8ff5-b7cd22d98f58","task_key":"default--test--1815","task_revision_id":"1","upstream_id":"1815","short_description":"A state enacts a statute that prohibits \"anyone over60 years of age to run for…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['The petitioner must show the statute violates due process by depriving her of the right to be a candidate.', 'The state needs to show that the statute is rationally related to a compelling government interest.', 'Since a fundamental right is involved, the petitioner must show the regulation is necessary to vindicate a compelling government interest.', 'Since no fundamental right is involved, the state must show the age restriction is essential to maintain a legitimate government interest.', 'The state must prove that the age restriction is essential to maintain the efficiency of the government.', 'The petitioner must show the statute violates the fundamental right of freedom of expression.', 'Since no fundamental right is involved, the petitioner must show the age restriction is not rationally related to a legitimate government interest.']\",\"question\":\"A state enacts a statute that prohibits \\\"anyone over60 years of age to run for public office. \\\" A state senator has been in office for three terms and wishes to seek re-election. The senator, who is 61, brings suit challenging the constitutionality of the state statute. Which of the following best states the burden of persuasion?\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}