{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2ddba2e1-65f6-51fe-98e9-382573d54a31","task_key":"all--test--2ddba2e1-65f6-51fe-98e9-382573d54a31","task_revision_id":"1","upstream_id":"","short_description":"A defendant was arrested and prosecuted for the crime of false pretenses. At…","config":"all","split":"test","body":"{\"choices\":\"[\\\"A juror misunderstood the judge's instructions regarding the burden of proof.\\\", \\\"A juror, in violation of the court's instructions, read a newspaper article implicating the defendant in several other similar schemes.\\\", \\\"Ajuror fell asleep during defense counsel's closing argument.\\\", 'A juror admittedly stated during deliberations that he had a personal animosity toward the defendant.']\",\"question\":\"A defendant was arrested and prosecuted for the crime of false pretenses. At trial, the defendant testified that she prophesied the victim's imminent death. The defendant admitted that she told the victim she could save him if he brought a large sum of money wrapped in a handkerchief to a ritual. After the ritual, the defendant returned the handkerchief to the victim filled with waste paper rather than the money. After the defendant was convicted of false pretenses, she moved for a new trial and offered the affidavits of several jurors who sat on the case. An affidavit containing which of the following facts will most likely furnish the defendant's best basis for securing a new trial?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}