{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e0216dff-be3a-5b1b-a124-e74e3d90c4d5","task_key":"all--test--e0216dff-be3a-5b1b-a124-e74e3d90c4d5","task_revision_id":"1","upstream_id":"","short_description":"A nephew was short of cash and was waiting for his elderly aunt to die. His aunt…","config":"all","split":"test","body":"{\"choices\":\"['guilty, as a principal in the first degree.', 'guilty, as a principal in the second degree.', 'guilty, as an accessory after the fact.', 'not guilty.']\",\"question\":\"A nephew was short of cash and was waiting for his elderly aunt to die. His aunt was currently in the hospital on a ventilator. Her condition was terminal, and the nephew could not wait to get his hands on his inheritance. One night, his girlfriend demanded that he buy her an engagement ring or she would break up with him. Out of time, the nephew went to the hospital and broke into the cabinet where the drugs were kept. Unbeknownst to the defendant, a nurse in the hospital, the nephew injected 1,000 mg's of a powerful muscle relaxant into the IV bag bound for his aunt's room. Ten mg's is the prescribed dosage of the muscle relaxant. The defendant, unaware of the IV's lethal capability, attached the new bag to the aunt's IV drip. The aunt's death was swift, and attempts to revive her were futile. The nephew celebrated his inheritance with a bottle of Champagne with his girlfriend. Unfortunately for the nephew, his aunt had changed her will some months prior to this, and all the aunt's money was left to her dog. If the defendant is prosecuted for administering the IV, she will most likely be found\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}