{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"093529b8-95f0-592e-891a-896f0a73e566","task_key":"all--test--093529b8-95f0-592e-891a-896f0a73e566","task_revision_id":"1","upstream_id":"","short_description":"A nephew brings an action against the administrator of his uncle's estate based…","config":"all","split":"test","body":"{\"choices\":\"['sustain the objection, because the sister-in-law is not a handwriting expert.', \\\"sustain the objection, because of the Dead Man's Statute.\\\", 'overrule the objection, because the letter qualifies as a past recollection recorded, an exception to the hearsay rule.', 'overrule the objection, because an authenticating witness need not be an expert if familiar with the handwriting of the person in question.']\",\"question\":\"A nephew brings an action against the administrator of his uncle's estate based upon a contract for services rendered in the management of his uncle's property. In order to rebut the presumption that the services rendered were gratuitous, since the nephew was a relative of his uncle, the nephew called his sister-in-law as a witness. Assume that this jurisdiction has a relevant Dead Man's Statute in effect. The sister-in-law testified that she had lived in the nephew's house, knew his uncle, and that she was familiar with the uncle's handwriting. The nephew's attorney asked her to look at a letter and to tell the court whether it was written by the uncle. Upon objection by the attorney for the administrator of the estate, the trial judge would most likely\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}