{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"446a0d62-0deb-5aad-ade4-090aee064f81","task_key":"all--test--446a0d62-0deb-5aad-ade4-090aee064f81","task_revision_id":"1","upstream_id":"","short_description":"The police requested consent from a wife to search the mutual bedroom of her and…","config":"all","split":"test","body":"{\"choices\":\"['No, the search was unconstitutional because a wife cannot give consent for her husband.', \\\"No, the search was unconstitutional because the items were under the husband's control and the wife therefore had no authority to give consent.\\\", 'Yes, the search was proper because one who possesses joint authority over property can validly consent on behalf of the absent occupant.', 'The search was unconstitutional because the police did not have a search warrant.']\",\"question\":\"The police requested consent from a wife to search the mutual bedroom of her and her husband. The husband was out of town. The police were looking for evidence of the husband's suspected activities in a major drug trafficking plot. The wife gave her voluntary consent to the search. The police found a kilo of cocaine in a dresser drawer and various written notes that contained the names and phone numbers of co-conspirators. After the husband was arrested, he moved for suppression of all of the evidence seized in his bedroom. Will the court likely deny the motion due to the voluntary consent given by the wife?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}