{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4762a6de-cc41-530f-b671-82f08dbf1bb9","task_key":"all--test--4762a6de-cc41-530f-b671-82f08dbf1bb9","task_revision_id":"1","upstream_id":"","short_description":"A wife was unhappily married to her husband, an alcoholic. When the husband got…","config":"all","split":"test","body":"{\"choices\":\"[\\\"No, because the wife's belief in the necessity of deadly force in self-defense was unreasonable.\\\", 'No, because even though the wife was the victim of spousal abuse, she could have avoided the danger by safely retreating.', \\\"Yes, because, on these facts, a reasonable jury could conclude that the wife acted in self- defense by using necessary force to protect herself from the husband's constant violent attacks.\\\", \\\"Yes, because a criminal defendant's Sixth Amendment right to a jury trial prohibits a court from refusing to submit affirmative defenses to the jury.\\\"]\",\"question\":\"A wife was unhappily married to her husband, an alcoholic. When the husband got drunk, he would become abusive and beat the wife. During the course of their marriage, the beatings became more violent and more frequent. Unable to endure the physical abuse any longer, the wife hired a hit man to kill her husband. One night while the husband was asleep, the hit man entered the home with a key given to him by the wife and shot the husband to death. Afterward, the wife was prosecuted for murder as an accomplice. At trial, the prosecution presented the facts outlined above. Thereafter, the defense sought to have the judge instruct the jury that the wife acted in self- defense under the battered women's syndrome. Based on the given facts, should the judge give such an instruction to the jury?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}