{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"13bb0cb4-520d-500c-a18a-6b07e71126d3","task_key":"all--test--13bb0cb4-520d-500c-a18a-6b07e71126d3","task_revision_id":"1","upstream_id":"","short_description":"A state has a statute prohibiting the sale of cigarettes to any person under the…","config":"all","split":"test","body":"{\"choices\":\"['guilty, because the offense does not require any mental state.', \\\"guilty, because the defendant's intoxication was voluntaiy.\\\", 'not guilty, because the defendant was unconscious.', \\\"not guilty, because the defendant's employer is vicariously liable for the violation that occurred.\\\"]\",\"question\":\"A state has a statute prohibiting the sale of cigarettes to any person under the age of 17. Violation of the statute is a misdemeanor punishable by a fine not less than $500 or more than $5,000 The state courts have interpreted this statute as a public welfare offense requiring no particular mental state for its violation. As such, this is a strict liability crime whereby culpability is imposed on a defendant for doing the proscribed act. The defendant, a recovering alcoholic, worked as a cashier at a drug store. Late one night while the defendant was working alone, he got the urge to have a drink. He opened a bottle of rum that the store sold and soon began drinking. A short time later, the defendant became inebriated and passed out. Not long thereafter, a 15-year-old girl entered the store to purchase a package of cigarettes. She took a box off the shelf and went to the cashier's counter to pay for them. Seeing the defendant lying on the floor, unconscious, the girl left the exact price for the cigarettes on the countertop and left the store. If the defendant is prosecuted for violating the state statute, he should be found\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}