{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f128dd4a-e6e9-52ec-93fd-7fbf47fcbeb2","task_key":"all--test--f128dd4a-e6e9-52ec-93fd-7fbf47fcbeb2","task_revision_id":"1","upstream_id":"","short_description":"After a fire destroyed her home, a plaintiff sued the insurance company that…","config":"all","split":"test","body":"{\"choices\":\"['It is admissible only if the company produces corroborative evidence, such as a mailing checklist.', 'It is admissible without more, because it is evidence of the routine practice of a business.', \\\"It is inadmissible, because evidence of the mailroom employee's general practice does not prove the particular mailing.\\\", 'It is inadmissible, because the billing clerk lacks personal knowledge of the actual mailing. mailing.']\",\"question\":\"After a fire destroyed her home, a plaintiff sued the insurance company that insured the home for the proceeds of her policy. The company claimed that the policy had lapsed. At trial, the plaintiff admits that she failed to make a timely premium payment; however, she cites a policy provision that required the company to give her notice that it had not received the premium by a specified date and testifies that she never received such a notice. The company then calls its chief billing clerk, who is company then calls its chief billing clerk, who is prepared to testify that, because of the plaintiff's unusual name, the clerk remembers preparing the plaintiff's notice and placing it in the \\\"out\\\" box on his desk, and that an employee from the company's mailroom daily picks up all mail from office \\\"out\\\" boxes and places it in a U.S. mail deposit box. How should the court rule on the admissibility of the billing clerk's testimony?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}