{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e3979e5a-8692-5423-b142-32e260cf473c","task_key":"all--test--e3979e5a-8692-5423-b142-32e260cf473c","task_revision_id":"1","upstream_id":"","short_description":"A state has a statute prohibiting the sale of guns and ammunition to any person…","config":"all","split":"test","body":"{\"choices\":\"['guilty, because she purchased the shotgun while under the statutory age.', 'guilty, because the statute imposes absolute criminal liability.', 'not guilty, provided she was unaware that the statute prohibited the sale of weapons to a person in her age group.', 'not guilty, provided that the legislative intent was not to make the purchase of shotguns a criminal offense.']\",\"question\":\"A state has a statute prohibiting the sale of guns and ammunition to any person under the age of 17. Violation of the statute is a felony punishable by a fine of $5,000 and imprisonment for up to two years. The state courts have interpreted this statute as a public welfare offense requiring no particular mental state for its violation. As such, this is a strict liability crime whereby culpability is imposed on a defendant for doing the proscribed act. A defendant, a 15-year-old, entered the store to purchase a shotgun as a present for her father. She took a shotgun off the shelf and went to the cashier's counter to pay for it. Not seeing the cashier anywhere, the defendant left the exact price for the shotgun on the countertop and left the store. If the defendant is prosecuted for violating the state statute, she should be found\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}