{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a5441474-80fb-546f-adba-5110f0264e21","task_key":"all--test--a5441474-80fb-546f-adba-5110f0264e21","task_revision_id":"1","upstream_id":"","short_description":"A security guard relocated to a state which required all persons wishing to…","config":"all","split":"test","body":"{\"choices\":\"['The security guard has the burden of persuasion to show that the state does not have a compelling state interest in enacting such legislation.', 'The security guard has the burden of persuasion to show that the denial of a license to work in private security violates his rights of due process.', 'The state has the burden of persuasion to show a compelling state interest in enacting such legislation.', \\\"The state has the burden of persuasion to show that the denial of a license to work in private security does not violate the petitioner's rights of due process.\\\"]\",\"question\":\"A security guard relocated to a state which required all persons wishing to practice private security to have graduated from a security training program within the state. The security guard, having already graduated from a program in his former state, wishes to work again as a private security guard. He began to advertise his services but was informed by the state that he must cease and desist from working as a private security guard until he complied with state law and graduated from an in-state program. The security guard challenges the constitutionality of the licensing statute on grounds that it violates the due process clause of the Fourteenth Amendment. Which of the following statements is most accurate?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}