{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"533b346a-598e-5fb1-bc46-39a1c6ad03b2","task_key":"all--test--533b346a-598e-5fb1-bc46-39a1c6ad03b2","task_revision_id":"1","upstream_id":"","short_description":"A state legislature passed a law requiring state universities to have male and…","config":"all","split":"test","body":"{\"choices\":\"['Since the law deals with the fundamental right of privacy, the state must show that it furthers a compelling state interest.', 'Since the law deals with the freedom of association, the state must show that it furthers a compelling state interest.', 'Since the law involves gender discrimination, the state must prove that the law is substantially related to an important state interest.', 'Since the law does not affect a fundamental right or involve gender discrimination, the burden is on the plaintiffs to show that it is not rationally related to a legitimate governmental interest.']\",\"question\":\"A state legislature passed a law requiring state universities to have male and female students live in separate dormitory facilities. The law was passed in order to curtail the increasing number of co-ed pregnancies on college campuses. Two students at a state university are engaged to be married and wish to share a dormitory room together. Citing the law, university housing officials refuse to allow them to live together in a campus dormitory facility. The students bring an appropriate action to challenge the constitutionality of the law. Which of the following correctly states the applicable burden of persuasion?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}