{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6bc53c91-54b6-5c0d-84a0-372822ee780e","task_key":"all--test--6bc53c91-54b6-5c0d-84a0-372822ee780e","task_revision_id":"1","upstream_id":"","short_description":"A defendant is on trial for attempting to cash a forged check at a bank. A…","config":"all","split":"test","body":"{\"choices\":\"['inadmissible, because the witness is at fault in allowing the loss of the original by failing to secure the check.', 'inadmissible, because it is not possible for the jury to compare the signature on the check since it was not presented as evidence.', \\\"admissible, because it is rationally related to the witness's perception.\\\", \\\"admissible, because the witness was familiar with the alleged victim's handwriting.\\\"]\",\"question\":\"A defendant is on trial for attempting to cash a forged check at a bank. A teller at the bank is called to testify. The teller testified that she was on duty when the defendant came to her station and handed her a check drawn on the account of another customer. She recognized the forgery because she knew the other customer's signature since he was one of her regulars. The teller further testified that after becoming suspicious, she placed the check down on the counter and turned to talk to her supervisor. As she did so, the defendant picked up the check and left the bank before she could say anything. The check that the defendant presented at the bank was not recovered by law enforcement authorities and was not offered as evidence. The teller's testimony regarding the forged signature on the check is\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}