{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2cf74762-b9e8-5386-9ecf-b62078d2599b","task_key":"all--test--2cf74762-b9e8-5386-9ecf-b62078d2599b","task_revision_id":"1","upstream_id":"","short_description":"A husband suspected that his wife was having an affair. He found a letter in her…","config":"all","split":"test","body":"{\"choices\":\"['No, voluntary manslaughter is only available when the adultery is witnessed in real time by the defendant.', 'No, mere words are never a sufficient provocation to establish voluntary manslaughter.', 'Yes, an admission of adultery always justifies a jury charge of voluntary manslaughter.', 'Yes, there was sufficient provocation to justify a jury charge of voluntary manslaughter.']\",\"question\":\"A husband suspected that his wife was having an affair. He found a letter in her car addressed to her boyfriend. When he confronted her with it she laughed derisively, admitted to the adultery in sordid detail, and taunted him with insults. He got into a rage and killed her on the spot. In the trial for first degree murder, defense counsel asked for a jury charge of voluntary manslaughter. The trial judge refused. On appeal will the husband prevail on an argument that the facts justified a charge of voluntary manslaughter?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}