{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0dee5a7c-34dd-5ef2-a82f-e909a876c59c","task_key":"all--test--0dee5a7c-34dd-5ef2-a82f-e909a876c59c","task_revision_id":"1","upstream_id":"","short_description":"A plaintiff is the beneficiary of a policy issued by an insurance company…","config":"all","split":"test","body":"{\"choices\":\"['admissible as a declaration against interest.', 'admissible as former testimony.', 'inadmissible, because of collateral estoppel.', 'inadmissible, because of double jeopardy.']\",\"question\":\"A plaintiff is the beneficiary of a policy issued by an insurance company insuring the life of his wife, now deceased. The policy contains a clause providing that double indemnity is payable in the event that death of the insured \\\"results directly, and independently of all other causes, from bodily injury effected solely through external violent and accidental means. \\\"The plaintiff's wife met her death in the silage shed of her farm. The death resulted from wounds caused by the discharge of a double-barreled shotgun. The plaintiff was arrested and prosecuted for the murder of his wife. After a lengthy trial, the plaintiff was acquitted of the charge. After the insurance company refused to pay the plaintiff's insurance claim, the plaintiff instituted this civil action. The complaint sets forth the policy, alleges the facts surrounding the death of the insured, avers that the death was within the policy provisions for double indemnity payment, and demands judgment accordingly. At trial, the insurance company's attorney proposes to introduce excerpts from the plaintiff's murder trial. The plaintiff's attorney objects to the introduction of such evidence. The trial judge should rule the proffered evidence\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}