{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"26ba10ea-09ad-5fd7-ab1f-05582bc150f6","task_key":"all--test--26ba10ea-09ad-5fd7-ab1f-05582bc150f6","task_revision_id":"1","upstream_id":"","short_description":"A bank teller was on trial for embezzlement. The prosecution offered into…","config":"all","split":"test","body":"{\"choices\":\"['No, because the trial court has wide discretion in allowing documentary evidence that is regularly kept by a business.', 'Yes, because a qualified bank employee must first authenticate them in person or provide a certification in compliance with the rules.', 'No, because business records kept on a regular basis are allowed as an exception to the hearsay rule and no further qualification is required.', 'Yes, because bank records are not included in the hearsay exception for business records.']\",\"question\":\"A bank teller was on trial for embezzlement. The prosecution offered into evidence the bank's daily deposit and tally records for a six month period, to show that total deposits did not reconcile with the total funds received and recorded. The prosecution tried to enter the records as exhibits without certification or the testimony of an official bank custodian of records. Defense counsel objected on the basis of hearsay. Is the court likely to order the evidence inadmissible without further proof of authenticity?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}