{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fc72ebbf-d2e1-5599-b004-c6cb559f524c","task_key":"all--test--fc72ebbf-d2e1-5599-b004-c6cb559f524c","task_revision_id":"1","upstream_id":"","short_description":"Congress enacts a statute that makes Pennsylvania Avenue a one-way street.…","config":"all","split":"test","body":"{\"choices\":\"['It is valid because Congress has exclusive power over the District of Columbia.', \\\"It is valid because it is a proper exercise of Congress's enumerated property power.\\\", 'It is invalid because the Washington, D. C. , City Council has exclusive power over the public thoroughfares within the District of Columbia.', 'It is invalid because it is a discriminatory burden on interstate commerce.']\",\"question\":\"Congress enacts a statute that makes Pennsylvania Avenue a one-way street. Congress has enacted the statute solely for the purpose of enabling members of Congress to travel back and forth to the Capital without being tied up in heavy traffic each day. Before Congress enacted this law, the Washington, D. C. , City Council had previously passed an ordinance designating Pennsylvania Avenue as a two-lane street. Which of the following is the most accurate statement regarding the constitutionality of the federal statute designating Pennsylvania Avenue a one-way street?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}