{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"028e5075-d0ef-5049-8540-c1e02e9a9150","task_key":"all--test--028e5075-d0ef-5049-8540-c1e02e9a9150","task_revision_id":"1","upstream_id":"","short_description":"A defendant was arrested one morning by a police officer for the attempted…","config":"all","split":"test","body":"{\"choices\":\"['The defendant was not entitled to be re-warned of his Miranda rights in the patrol car.', 'The defendant was not interrogated in the patrol car.', 'The defendant waived his right to consult counsel.', \\\"The seizure of the gun was not the fruit of the defendant's statement.\\\"]\",\"question\":\"A defendant was arrested one morning by a police officer for the attempted murder of the victim. The defendant had allegedly fired three shots at the victim, a physical education teacher, in the schoolyard of an elementary school. Immediately after the arrest, the arresting officer advised the defendant of his Miranda rights. The defendant responded that he would not make any statement until he consulted his attorney. Within minutes, a patrol car arrived and the defendant was taken into the car to be transported to the police station. The arresting officer sat in the front, next to the driver, and the defendant sat alone in the back seat, with his hands cuffed. On the way to the station, the driver stated to the arresting officer, \\\"I hope that the gun involved in this crime doesn't get into the hands of those small children, because one of them could be seriously injured, to say the least. \\\" The defendant interrupted the officers and told them where to look in the schoolyard for the abandoned gun. As a result of this information, the police found the gun where the defendant said it was. What is the state's best rebuttal to the defendant's argument that the gun was illegally seized?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}