{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2a80b1be-747e-5904-b6a3-005a801cdcb6","task_key":"default--test--1568","task_revision_id":"1","upstream_id":"1568","short_description":"A state was facing a fiscal problem. In order to raise funds, the state decided…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['It goes against the Supremacy Clause as it conflicts with federal laws governing postal services.', 'It is a violation of the Tenth Amendment as it encroaches on the powers reserved for the federal government.', 'It interferes with the sovereign autonomy of the U. S. Postal Service to operate as an independent federal agency.', 'It denies citizens of the state who are not state government employees their rights under the privileges or immunities clause of the Fourteenth Amendment.', 'It infringes on the First Amendment rights of individuals by limiting their choice of postal service.', 'It constitutes a violation of the commerce clause, as it interferes with interstate commerce.', 'It infringes on the rights of non-residents who might want to use the service.', 'It constitutes a denial of equal protection of the laws, because employees of the state receive personal benefits that are not enjoyed by employees of other states.', 'The negative implications that flow from the delegation to Congress of the power to establish a post office prohibit such a state postal service.']\",\"question\":\"A state was facing a fiscal problem. In order to raise funds, the state decided to consider the creation of a state postal service that only its residents may use for intrastate mail. The price for stamps printed by the state postal service would be half the cost of stamps printed by the U. S. Postal Service and would always be guaranteed to arrive within 24 hours. In addition, any employees of the state would be able to send their mail for free through the state postal service. Which of the following is the strongest constitutional argument against the proposed legislation?\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}