{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6bd17d33-1027-5b89-b0d5-3cecfb51233e","task_key":"all--test--6bd17d33-1027-5b89-b0d5-3cecfb51233e","task_revision_id":"1","upstream_id":"","short_description":"A defendant offers into evidence his computer business records to show his good…","config":"all","split":"test","body":"{\"choices\":\"['The court will allow the records because they were kept in the ordinary course of business.', 'The court will require a greater foundation to establish the reliability of the records.', 'The court will dismiss the hearsay objection because the defendant, who is the declarant, is available in court.', 'The court will allow the records because they are the product of a reliable computer process of data collection.']\",\"question\":\"A defendant offers into evidence his computer business records to show his good faith monitoring of the accounts in his business. The defendant testifies that he kept the records on a regular business basis €“ but did not explain the records in any other way. The government objected to the records as being hearsay and not authenticated. What will the court decide regarding the admissibility of the computer business records?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}