{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"969ed940-27cd-5983-b2b1-ab1b77cf3114","task_key":"all--test--969ed940-27cd-5983-b2b1-ab1b77cf3114","task_revision_id":"1","upstream_id":"","short_description":"The owner of a meatpacking company was charged under a state criminal code…","config":"all","split":"test","body":"{\"choices\":\"[\\\"No, because there was insufficient proof of the owner's actus reus.\\\", \\\"No, because there was insufficient proof of the owner's mens rea.\\\", \\\"Yes, because an appellate court cannot second-guess a jury's verdict.\\\", \\\"Yes, because the evidence was sufficient to support the jury's verdict.\\\"]\",\"question\":\"The owner of a meatpacking company was charged under a state criminal code prohibiting the sale of contaminated meat. The state's highest court has construed the code as imposing strict and vicarious liability to the extent allowed by the federal Constitution. The evidence at trial established that the owner's company had sold contaminated meat that had sickened hundreds of consumers. It further showed, however, that the owner had been out of the country when the meat was sold and had had no reason to know that any of the meat was contaminated. The jury convicted the owner, and the court sentenced him to a large fine and probation. On appeal, the owner has challenged the sufficiency of the trial evidence. Should the appellate court uphold the conviction?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}