{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"32454d98-5b89-5e43-8c68-f62363a01071","task_key":"all--test--32454d98-5b89-5e43-8c68-f62363a01071","task_revision_id":"1","upstream_id":"","short_description":"The police were called to a domestic dispute. The wife told police that her…","config":"all","split":"test","body":"{\"choices\":\"['The search was invalid and the evidence must be suppressed because the co-occupant of the premises was present and specifically refused to give consent to the search.', \\\"The search was valid because the cases say that one occupant's consent to the search overrules the other occupant's refusal to consent.\\\", \\\"The search was valid because the wife's statement established probable cause that a crime was being committed \\\\x80\\\\x93 this created exigent circumstances for the search.\\\", 'The search was invalid because, even though consent was given, the police must first attempt to get a search warrant to enter a home.']\",\"question\":\"The police were called to a domestic dispute. The wife told police that her husband was abusive and that he was a heavy cocaine user. The husband was present and denied the allegation. Police asked for permission to search the premises for drugs, which was consented to by the wife. The husband, however, refused to consent to the search. The police went ahead anyway and found drugs in the husband's belongings. After being arrested on drug charges, the husband filed a motion for suppression of the evidence based on lack of consent. What should be the likely decision of the trial court?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}