{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c939be21-ce4d-5ad5-9404-221e2bab2e0f","task_key":"all--test--c939be21-ce4d-5ad5-9404-221e2bab2e0f","task_revision_id":"1","upstream_id":"","short_description":"A patient who had surgery to repair a rupture in her spleen followed up with a…","config":"all","split":"test","body":"{\"choices\":\"['She does not have to produce the MRI scan because a layperson can testify to things of common knowledge, such as what a sponge looks like.', 'She does have to produce the MRI scan because a layperson cannot testify to personal observations.', 'She does not have to produce the MRI scan because she can testify as to the content of her own medical records.', 'She must produce the MRI records because it represents the best evidence under the best evidence rule.']\",\"question\":\"A patient who had surgery to repair a rupture in her spleen followed up with a full body MRI due to excruciating pain that had developed. During the MRI, the technicians saw at least two identifiable sponges that had been left in her body. She had to be hospitalized for additional surgery. The patient sued the hospital and doctor for medical malpractice. She did not produce the printouts of the MRI. Instead, she attempted to testify to what she observed on the MRI scan. The defense objected and insisted that she must produce the actual MRI printouts. What is the most likely ruling of the trial judge with respect to the objection?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}