{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"29ae22a1-673a-5835-8e87-4ee1f30f7fdb","task_key":"all--test--29ae22a1-673a-5835-8e87-4ee1f30f7fdb","task_revision_id":"1","upstream_id":"","short_description":"A state has recently enacted a statute wherein aliens are prohibited from owning…","config":"all","split":"test","body":"{\"choices\":\"['the state has the burden of proof to show that there is a compelling state interest to support the statute.', 'the burden of proof is on the resident aliens to show that there is no compelling state interest to support the statute.', 'the resident aliens do not have standing.', 'either resident alien has standing, but not both.']\",\"question\":\"A state has recently enacted a statute wherein aliens are prohibited from owning any commercial real estate within the state. Subsequent to the statute, a lawful resident alien enters into a contract with another lawful resident alien to purchase the latter's office building. Assume that both resident aliens join in a declaratory judgment action to test the validity of the state statute in federal court. The court should rule that\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}