{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bfac2e12-6d68-59f1-98b9-803fbc7a5476","task_key":"all--test--bfac2e12-6d68-59f1-98b9-803fbc7a5476","task_revision_id":"1","upstream_id":"","short_description":"A federal statute governing food stamp fraud makes it a crime to knowingly…","config":"all","split":"test","body":"{\"choices\":\"['Conviction reversed, because a store owner is exempt from the statute, which applies only to consumers who use food stamps illegally.', 'Conviction reversed, because the better interpretation is that mens rea is included, and the owner must know his conduct is in violation of the criminal laws.', 'Conviction affirmed, because the meaning of knowingly does not connote that there must be specific knowledge by the actor that what he is doing is illegal.', 'Conviction affirmed, because the modern trend of the law is to recognize criminal liability without mens rea or specific criminal intent.']\",\"question\":\"A federal statute governing food stamp fraud makes it a crime to knowingly acquire or possess food coupons in a manner not authorized by the statute or the regulations. A grocery store owner purchased discounted food stamps from an undercover agent, and was arrested for violating the statute. At trial, the store owner claimed that the government must prove that he had the specific intent to commit a crime. The government contended it only had to show that he knowingly acquired food stamps, and that this was not a specific intent crime. The trial judge adopted the government's interpretation, and the store owner was convicted. His appeal made it all the way to the U.S. Supreme Court. Will the Court likely reverse or affirm the conviction and why?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}