{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1104469c-8156-5d82-a64d-ffefd507e19f","task_key":"all--test--1104469c-8156-5d82-a64d-ffefd507e19f","task_revision_id":"1","upstream_id":"","short_description":"During a custody dispute, a court granted the request of the defendant and…","config":"all","split":"test","body":"{\"choices\":\"['sustain the objection, because the blood tests are not conclusive evidence of paternity.', 'sustain the objection, because blood tests have not been generally recognized by the scientific community.', 'overrule the objection, because the court will take judicial notice of the accuracy of such tests.', 'overrule the objection, because the blood tests are an admission.']\",\"question\":\"During a custody dispute, a court granted the request of the defendant and appointed a clinical pathologist to conduct the blood grouping tests of the child, the complainant, and the defendant. After first stating all of his qualifications at the non-jury trial, the pathologist testified that he and his associates made five separate blood grouping tests and that all proper safeguards were taken to protect the integrity and accuracy of the tests. The pathologist also offered more detailed testimony about the testing procedures and stated that no discrepancies were found in the testing methods. Finally, the pathologist made the statement that the blood grouping tests were conclusive in proving that the defendant could not be the father of the child. If the complainant's attorney makes an objection to the introduction of the blood tests into evidence, the court will most likely\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}