{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a7cc3d2e-887f-5b1f-9f49-81a14aba27b8","task_key":"all--test--a7cc3d2e-887f-5b1f-9f49-81a14aba27b8","task_revision_id":"1","upstream_id":"","short_description":"A state was facing a fiscal problem. In order to raise funds, the state decided…","config":"all","split":"test","body":"{\"choices\":\"['It constitutes a denial of equal protection of the laws, because employees of the state receive personal benefits that are not enjoyed by employees of other states.', 'The negative implications that flow from the delegation to Congress of the power to establish a post office prohibit such a state postal service.', 'It denies citizens of the state who are not state government employees their rights under the privileges or immunities clause of the Fourteenth Amendment.', 'It interferes with the sovereign autonomy of the U. S. Postal Service to operate as an independent federal agency.']\",\"question\":\"A state was facing a fiscal problem. In order to raise funds, the state decided to consider the creation of a state postal service that only its residents may use for intrastate mail. The price for stamps printed by the state postal service would be half the cost of stamps printed by the U. S. Postal Service and would always be guaranteed to arrive within 24 hours. In addition, any employees of the state would be able to send their mail for free through the state postal service. Which of the following is the strongest constitutional argument against the proposed legislation?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}