{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4f18eed5-5c26-5802-94ef-ccdd6f3ffe3c","task_key":"all--test--4f18eed5-5c26-5802-94ef-ccdd6f3ffe3c","task_revision_id":"1","upstream_id":"","short_description":"In an attempt to promote safe sex a foundation began sending condoms in the…","config":"all","split":"test","body":"{\"choices\":\"['The statute is invalid because it violates the First Amendment protection of commercial free speech.', 'The statute is invalid because it unduly burdens interstate commerce.', 'The statute is invalid because it violates the Fifth Amendment right of privacy.', 'The statute is invalid because it violates the equal protection clause of the Fourteenth Amendment.']\",\"question\":\"In an attempt to promote safe sex a foundation began sending condoms in the mail. Thousands of Americans became incensed and objected to this type of unsolicited advertising. A group of people started a nationwide campaign against the use of condoms. This new organization also started a strong lobbying movement to have Congress pass legislation prohibiting the distribution of condoms by using the U. S. postal system. Assume that the lobbying effort was successful, and Congress passed a law prohibiting any unsolicited advertising for condoms to be distributed through the U. S. postal system. The foundation has challenged the constitutionality of this federal statute. The best argument against the constitutionality of this law is which of the following?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}