{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"70037647-f929-5c58-91ac-0431d635a1a8","task_key":"all--test--70037647-f929-5c58-91ac-0431d635a1a8","task_revision_id":"1","upstream_id":"","short_description":"A state assemblyman made a visit to a foreign country. To protest U. S. foreign…","config":"all","split":"test","body":"{\"choices\":\"['Federal criminal laws dealing with international affairs need not be as specific as those dealing with domestic affairs.', 'Under its enumerated powers, Congress may legislate to preserve the monopoly of the national government over the conduct of U. S. foreign affairs.', \\\"The President's inherent power to negotiate for the U. S. with foreign countries authorizes him to punish citizens who engage in such negotiations without permission, even in the absence of statutory authorization.\\\", 'Article I, Section 8 of the Constitution grants Congress concurrent power with the President to regulate external affairs with foreign countries.']\",\"question\":\"A state assemblyman made a visit to a foreign country. To protest U. S. foreign policy, the assemblyman and the foreign country's leader issued a joint statement criticizing the United States' involvement in the political affairs of neighboring countries. Following the assemblyman's return to the United States, he was prosecuted under a federal criminal statute making it unlawful for any citizen not specifically authorized by the President to negotiate with a foreign government for the purpose of influencing the foreign government in relation to a dispute with the United States. The law further provides that \\\"any citizen who knowingly counsels, aids, or abets a foreign government in a dispute with the United States. . , shall, upon conviction. . . be punished by imprisonment for not more than five years or a fine of not more than $10,000, or by both fine and imprisonment. . . . \\\"Which of the following is the strongest constitutional basis for upholding the validity of the aforementioned federal statute?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}