{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"acfab2d6-bc95-5168-87b7-1d253f73f266","task_key":"all--test--acfab2d6-bc95-5168-87b7-1d253f73f266","task_revision_id":"1","upstream_id":"","short_description":"A man was driving while drunk. He was speeding down a center city street,…","config":"all","split":"test","body":"{\"choices\":\"['Felony murder in that he killed someone while committing the felony of driving under the influence.', 'Voluntary manslaughter because it was an intentional killing done while acting recklessly or impulsively.', 'Involuntary manslaughter in that it was a killing committed while engaging in reckless activity but without the intent to kill.', 'First degree murder because the act of driving under the influence is legally presumed to involve premeditation and specific intent.']\",\"question\":\"A man was driving while drunk. He was speeding down a center city street, veering from lane to lane, when he lost control of his car while going over a slick puddle of water. Without realizing it, he drove his car onto the sidewalk and killed two persons. What common law crime most appropriately fits the man's situation?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}