{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"72e22a65-00f6-5cbb-b3fd-c66db1ef5926","task_key":"all--test--72e22a65-00f6-5cbb-b3fd-c66db1ef5926","task_revision_id":"1","upstream_id":"","short_description":"A very drunk man was sitting in a bar drinking. A businessman customer came and…","config":"all","split":"test","body":"{\"choices\":\"['Voluntary Manslaughter', 'First Degree Murder', 'Second Degree Murder', 'Involuntary Manslaughter']\",\"question\":\"A very drunk man was sitting in a bar drinking. A businessman customer came and sat beside him. They did not know each other. The businessman had slightly grazed against the drunk man's body. \\\"Man, are you trying to kill me or something?'' said the very drunk man. The businessman did not think anything of it, since he had barely grazed the drunkard. The drunk continued to bully the businessman, calling him made-up names, and saying things that were nonsensical to the businessman and to others at the bar who were listening to the drunk's boisterous and irrational rants. The drunk then took a gun out of his pocket and shot the businessman, killing him. At trial, the defense argued that the man could not form the specific intent to premeditate for first degree murder. Which of the following crimes is the defendant most likely guilty of under these facts?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}