{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5dd67604-c3fd-5bd5-b465-bb1008e81fcf","task_key":"all--test--5dd67604-c3fd-5bd5-b465-bb1008e81fcf","task_revision_id":"1","upstream_id":"","short_description":"A husband is charged with murder in the shooting death of his brother-in-law. In…","config":"all","split":"test","body":"{\"choices\":\"['the burden of production.', 'the burden of persuasion only.', 'both the burden of production and the burden of persuasion.', 'neither the burden of production nor the burden of persuasion.']\",\"question\":\"A husband is charged with murder in the shooting death of his brother-in-law. In the jurisdiction in which the husband is on trial for murder, the defense of insanity is an affirmative defense. The husband pleads insanity as his defense. At trial, in order to prove his defense of insanity, the husband has\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}