{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"002c24d3-8fa2-512c-b8bf-2f49651ce420","task_key":"all--test--002c24d3-8fa2-512c-b8bf-2f49651ce420","task_revision_id":"1","upstream_id":"","short_description":"While on routine patrol, police officers observed a driver make an illegal…","config":"all","split":"test","body":"{\"choices\":\"['the police conducted an automobile search.', 'the police conducted an inventory search.', 'the search was incident to a lawful arrest.', 'the search was made under exigent circumstances.']\",\"question\":\"While on routine patrol, police officers observed a driver make an illegal U-turn. After stopping the driver's car, they observed him reach under the driver's seat. They ordered him out of the car and saw a cellophane package protruding from under the seat. The package contained a white powdery substance, which the officers suspected to be cocaine. The officers placed the driver under arrest and put him in the rear of their patrol car. They then proceeded to search the rest of the driver's car. In the trunk they found an assault rifle that was later determined to be the weapon used in a liquor store robbery. Charged with that robbery, the driver moved to suppress the assault rifle as evidence on the grounds that the police did not have a warrant to search the trunk. The best theory that the prosecution can use in support of the admissibility of the assault rifle as evidence is that\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}