{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"50802575-a181-5853-992e-c85d9e08ba6c","task_key":"all--test--50802575-a181-5853-992e-c85d9e08ba6c","task_revision_id":"1","upstream_id":"","short_description":"A defendant was indicted for engaging in a fraudulent investment scheme. At the…","config":"all","split":"test","body":"{\"choices\":\"['No, because the burden of proof in a criminal action is different from the burden of proof in a civil action.', 'No, because the parties are not identical in the two actions.', 'Yes, because it is prior testimony of an unavailable declarant.', 'Yes, but only if the investor demonstrates that she was unable to obtain the testimony of the witness by deposition.']\",\"question\":\"A defendant was indicted for engaging in a fraudulent investment scheme. At the criminal trial, the prosecutor called a witness who had participated in the scheme with the defendant. The witness testified about the operation of the scheme and was cross-examined by the defendant's attorney. The case resulted in a mistrial. An investor who was allegedly defrauded by the scheme has now brought a civil action against the defendant. She seeks to introduce the witness's testimony from the criminal trial. The witness has testimony from the criminal trial. The witness has moved to a foreign country. Is the witness's testimony in the criminal trial admissible in the civil action?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}