{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0996a6ab-aa31-5de5-9521-3115271ec349","task_key":"all--test--0996a6ab-aa31-5de5-9521-3115271ec349","task_revision_id":"1","upstream_id":"","short_description":"A defendant was a senior pre-med student at a state university. Before a big…","config":"all","split":"test","body":"{\"choices\":\"['denied, because the defendant received Miranda warnings and was not compelled to incriminate himself.', 'denied, because the defendant volunteered the confession.', \\\"sustained, because the police lacked probable cause to search the defendant's home.\\\", \\\"sustained, because the defendant's statement was the product of a warrantless entry of his home.\\\"]\",\"question\":\"A defendant was a senior pre-med student at a state university. Before a big football game with their arch rival, the defendant attended a pep rally at the university football field. During the pep rally, the students drank beer, sang songs, and gave members of the football team fervent cheers. After the rally ended, the defendant was walking toward his car when he felt the need to relieve himself. He then strutted across the street to a municipal park and urinated against a tree. In this jurisdiction, urinating in public is a misdemeanor. Unknown to the defendant, a parking enforcement officer who was ticketing cars in the area witnessed the incident and wrote down the license number of the defendant's vehicle as he drove off. She immediately gave the information to the police who did a check and learned the defendant's identity and home address. Within an hour, the police went to the defendant's house and forcibly entered the dwelling without a search warrant. While searching his home, they found the defendant studying in an upstairs bedroom. After giving him his Miranda warnings, the defendant confessed to the crime. The defendant was thereafter prosecuted for the misdemeanor of urinating in public. If the defendant moves to suppress evidence of the statement that he made to the police when he was apprehended, the motion should be\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}