{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8c185dbe-e856-5c03-8b86-279f8220bf80","task_key":"all--test--8c185dbe-e856-5c03-8b86-279f8220bf80","task_revision_id":"1","upstream_id":"","short_description":"The board of a state university has adopted the following rule concerning…","config":"all","split":"test","body":"{\"choices\":\"['unconstitutional, because it constitutes a violation of the equal protection clause of the Fourteenth Amendment.', 'unconstitutional, because it constitutes a violation of the privileges and immunities clause of Article IV, Section 2.', 'constitutional, because the fee differential promotes a compelling state interest.', 'constitutional, because the provision does not trigger strict scrutiny.']\",\"question\":\"The board of a state university has adopted the following rule concerning residency requirements:\\\"A student will be considered a legal resident of the state for the purpose of registering at the university if such person is over the age of 21 and has established a legal residence in the state for at least one year next preceding the last day of registration for credit. \\\"A student moved to the state and immediately enrolled at the state university. Since he did not fulfill the university residency requirement, the student was required to pay $1,800 tuition each semester, which was $400 more than the tuition of state resident-students. In an action by the student challenging the constitutionality of the provision governing the determination of residency for the purpose of fixing a fee differential for out-of-state students in public college, the court will most likely declare the provision\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}