{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"dc48b973-e47f-563d-bd5e-c913b609e738","task_key":"all--test--dc48b973-e47f-563d-bd5e-c913b609e738","task_revision_id":"1","upstream_id":"","short_description":"During a defendant's trial for driving while intoxicated, the prosecutor called…","config":"all","split":"test","body":"{\"choices\":\"['affirmed, because the defendant had an opportunity to rebut the presumption.', \\\"affirmed, because the judge's instruction merely permitted the jury to reach a conclusion that they could have decided upon without the presumption.\\\", 'reversed, because the jury might determine that the instruction in effect relieves the prosecutor of the burden of proof beyond a reasonable doubt.', \\\"reversed, because such an instruction may be considered an indication of guilt and, therefore, violative of the defendant's privilege against self-incrimination.\\\"]\",\"question\":\"During a defendant's trial for driving while intoxicated, the prosecutor called a toxicologist to testif' as an expert witness. The toxicologist testified that the defendant's blood alcohol level, registered after his arrest, was 0. 14%. At the close of the toxicologist's testimony, the trial judge, over defense objections, instructed the jury that, in accordance with state law, a person with a blood alcohol level greater than 0. 10% is presumed to be intoxicated. No other instruction relating to that presumption was given. A relevant statute in this jurisdiction makes driving while intoxicated a felony and defines intoxication \\\"as a state of severely impaired mental and physical capacity caused by the ingestion of drugs or alcohol. \\\"The defendant was subsequently convicted of driving while intoxicated. On appeal, his conviction should be\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}