{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"06f62dfa-608d-59ef-b909-b7e237e9d1b2","task_key":"all--test--06f62dfa-608d-59ef-b909-b7e237e9d1b2","task_revision_id":"1","upstream_id":"","short_description":"The United States Congress passed, and the President signed, a law called the…","config":"all","split":"test","body":"{\"choices\":\"['The law is unconstitutional because it violates Title VII of the Civil Rights Act.', \\\"The law is unconstitutional because it is primarily discriminatory against women's rights.\\\", 'The law is unconstitutional because it violates procedural due process.', 'The law is unconstitutional because it infringes on fundamental rights of the individual.']\",\"question\":\"The United States Congress passed, and the President signed, a law called the \\\"American Morality Leadership Act\\\" which limits the amount of makeup that women or men can wear in public and precludes the wearing of short dresses. Men over 65 must wear only brown or grey attire, while those under 65 must wear button down dress shirts with neckties, except for when they are exercising or working physically. The Act has other restrictions and specifications for dress and grooming mandates for men and women. A class action was filed to challenge the Act based on a constitutional attack. Which argument listed below more closely reflects the constitutional argument that is most likely to succeed in court?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}