{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d840e97f-26cb-5b6b-8a74-7c62c1a746b2","task_key":"all--test--d840e97f-26cb-5b6b-8a74-7c62c1a746b2","task_revision_id":"1","upstream_id":"","short_description":"An avowed corrimunist was elected vice president of a union. A senator, in his…","config":"all","split":"test","body":"{\"choices\":\"[\\\"The statutory provision is a form of unconstitutional prior restraint on a person's First Amendment right of free association.\\\", 'Making it a crime for a Communist to hold a union office is a suspect classification, which violates the equal protection clause.', 'The statutory prohibition is a reasonable method of discrimination since the benefit to the public outweighs the injury or restrictions that would be inflicted upon the person.', 'The statutory provision in the act is a form of legislative punishment violative of the Constitution as a bill of attainder.']\",\"question\":\"An avowed corrimunist was elected vice president of a union. A senator, in his investigation of communist infiltration of national labor unions, found a provision in a statute passed by Congress, which makes it a crime for a member of the communist party to act as an official of a labor union. After a subsequent legislative hearing, the communist is dismissed from his position by the union. Which of the following most accurately summarizes the applicable rule of constitutional law regarding the aforementioned provision of the statute?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}