{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"15f95f0c-f732-512c-8a84-f016fbf16a91","task_key":"default--test--892","task_revision_id":"1","upstream_id":"892","short_description":"A resident announced his candidacy for state representative. A law in the state…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['A similar authenticating statute was held to be constitutional in another state the previous year.', 'Other states also have similar authenticating requirements.', 'The authenticating requirement ensures that only serious and committed candidates run for office.', 'The resident did not actively campaign to get the necessary signatures.', 'The authenticating requirement was introduced to reduce the number of frivolous candidates.', 'The authenticating requirement was necessary to further a compelling state interest.', 'Two other candidates had successfully petitioned to have their names included on the ballot.', 'The resident has a history of fraudulent activities.', 'The resident could have obtained the necessary signatures if he had started collecting them earlier.', \\\"The resident's petition contained a large number of false signatures.\\\"]\",\"question\":\"A resident announced his candidacy for state representative. A law in the state requires new political entrants (regardless of party affiliation) to obtain three times the number of signatures as other candidates who have run for office previously. The resident, however, failed to obtain the necessary number of authenticating signatures to have his name placed on the ballot. The resident filed a complaint in federal district court alleging the unconstitutionality of the authenticating requirement. Which of the following, if established, is the state's strongest argument for sustaining the validity of the authenticating requirement?\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}