{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9c59ed09-4c3c-545b-8775-9ce4d43711f2","task_key":"default--test--1680","task_revision_id":"1","upstream_id":"1680","short_description":"A testator died and through his will gave his entire estate to charity, but the…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['admissible, as it falls under the exception to the hearsay rule for statements of personal or family history.', 'admissible, because the clerk had personal knowledge of the matter.', 'admissible as a pedigree exception to the hearsay rule.', \\\"inadmissible, because the clerk's testimony is considered hearsay.\\\", \\\"inadmissible, because it is a violation of the testator's privacy.\\\", \\\"inadmissible, because the clerk's testimony is not the best evidence.\\\", \\\"admissible, because it provides evidence of the couple's public recognition as husband and wife.\\\", \\\"inadmissible, under the Dead Man's Statute.\\\", 'inadmissible, as the hotel register is not a legal document establishing marriage.', 'admissible, as it provides evidence of a common law marriage.']\",\"question\":\"A testator died and through his will gave his entire estate to charity, but the gift failed because the will was executed 10 days prior to the testator's death. A man then filed a claim against the estate, alleging that he was the son and heir of the testator. At the trial on the man's claim, the man was unable to produce any proof of a ceremonial marriage, but established the following by undisputed evidence: (a) that his mother and the testator had cohabited for a number of years; and (b) that his mother had predeceased the testator by one day. Assume that this jurisdiction has a relevant Dead Man's Statute in effect. At trial, the man's attorney called a clerk at a winter resort hotel. The clerk testified that the testator and the man's mother had come to the hotel for many years and he often saw the testator sign the hotel register as \\\"Mr. and Mrs. Testator. \\\"The trial court should rule the clerk's testimony \",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}