{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8a0de3f9-7658-5c32-8c2b-01f18cc83147","task_key":"all--test--8a0de3f9-7658-5c32-8c2b-01f18cc83147","task_revision_id":"1","upstream_id":"","short_description":"In a false imprisonment action by a plaintiff against a defendant, the plaintiff…","config":"all","split":"test","body":"{\"choices\":\"['admissible as substantive evidence.', 'admissible for impeachment purposes only.', \\\"inadmissible, because the defendant's attorney failed to question the witness about the affidavit while on the stand.\\\", 'inadmissible as hearsay not within any recognized exception.']\",\"question\":\"In a false imprisonment action by a plaintiff against a defendant, the plaintiff calls a witness to testify that the incident occurred on particular date. The witness was not questioned about an affidavit he made for trial in which he stated that the incident occurred on a different date. After the witness left the stand, but before he was excused, the defendant's attorney offers into evidence the affidavit. Assuming that the affidavit is properly authenticated, the trial judge should rule it\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}