{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a8e31e72-6dd2-5250-a20a-bf4897ff7a1c","task_key":"all--test--a8e31e72-6dd2-5250-a20a-bf4897ff7a1c","task_revision_id":"1","upstream_id":"","short_description":"A man and a woman conspired together to rob a bank. As they were exiting the…","config":"all","split":"test","body":"{\"choices\":\"['Yes, because the felony murder rule has been declared unconstitutional.', 'Yes, because the majority view is that felony murder does not apply if a co-conspirator is killed by a third person during the commission of the crime.', 'No, because all states recognize that felony murder applies to any deaths that occur during the commission of the crime regardless of who fired the fatal shot.', \\\"No, because the man started the flurry of shots instead of surrendering; he caused the woman's death and is guilty of first degree murder.\\\"]\",\"question\":\"A man and a woman conspired together to rob a bank. As they were exiting the bank after the robbery they were confronted by armed tactical police officers. The man raised his gun at the officers and a flurry of shots followed. The man was injured but survived; the woman co-conspirator died from a police officer's bullet. The authorities charged the man with felony-murder of the woman. He was convicted and appealed. Under the prevailing modern view of felony murder, will the appellate court likely reverse the first-degree murder conviction?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}