{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ddc820c2-f3d0-5283-a51f-6a484c8b97e6","task_key":"all--test--ddc820c2-f3d0-5283-a51f-6a484c8b97e6","task_revision_id":"1","upstream_id":"","short_description":"A permanent resident alien applied for a position as a state trooper. A state…","config":"all","split":"test","body":"{\"choices\":\"[\\\"constitutional, because the statute is within the state's plenary power to regulate the health, safety, and welfare of its citizens.\\\", 'constitutional, because citizenship bears a rational relationship to the special demands of the police function.', 'unconstitutional, because it constitutes a violation of the equal protection clause of the Fourteenth Amendment.', 'unconstitutional, because it constitutes a violation of the due process clause of the Fourteenth Amendment.']\",\"question\":\"A permanent resident alien applied for a position as a state trooper. A state trooper is a member of the state police force, a law enforcement body that exercises broad police authority throughout the state. The position of state trooper is filled on the basis of competitive examinations taken by all of the applicants. After the resident alien applied for the position, the state authorities refused him permission to take the qualifying examination. The state authorities based their refusal on state statute, which provided:\\\"No person shall become a member of the state police unless he/she shall be a citizen of the United States. \\\"Thus, under this provision, as a prerequisite to becoming a member of the state police, an alien must relinquish his foreign citizenship and become a citizen. In an opinion upholding the validity of the statute, the State Attorney General noted that since police officers fall within the category of important non-elective officials who participate directly in the execution of broad public policy, only citizens of the United States should be qualified to apply for such positions. \\\"At the time the resident alien applied for a position as a state trooper, he was a citizen of a foreign country and not currently eligible for citizenship. As a result of a federal statute, Congress has imposed a five-year residency requirement for the attainment of citizenship. Under this federal law, an alien must reside in this country for a period of five years as a prerequisite before applying for citizenship. At this time, the resident alien had only lawfully been residing in the United States for two years, and thus would not be eligible to apply for naturalization until three years later. If the resident alien brings suit in federal court challenging the constitutionality of the state statute limiting the membership of its state police force to citizens of the United States, the court will most likely declare the statute\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}