{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a85f5473-70aa-539c-af10-0bb794ad1574","task_key":"all--test--a85f5473-70aa-539c-af10-0bb794ad1574","task_revision_id":"1","upstream_id":"","short_description":"A husband and wife had been married for 10 years. The wife obtained a divorce…","config":"all","split":"test","body":"{\"choices\":\"['admissible, under both the marital and spousal privileges.', 'admissible, under the spousal privilege but not admitted under the marital privilege.', 'admissible, under the marital privilege but not admitted under the spousal privilege.', 'inadmissible, under either the marital or spousal privileges.']\",\"question\":\"A husband and wife had been married for 10 years. The wife obtained a divorce from the husband after learnitg that he was engaging in an extramarital love affair with one of his co-workers. Following the divorce, the husband was arrested and charged with embezzling funds from his employer during a two- year period. In preparing for trial, the prosecuting attorney interviewed the wife, who stated that during their marriage, the husband admitted committing the embezzlement. This jurisdiction has adopted both the common-law marital and spousal privileges. At the husband's trial, the wife is called to testify regarding statements the husband made to her during the marriage regarding commission of the crime. Upon objection by the husband's attorney, the wife's testimony will be\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}