{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"414f6a97-29d9-50cf-b727-79367516260b","task_key":"all--test--414f6a97-29d9-50cf-b727-79367516260b","task_revision_id":"1","upstream_id":"","short_description":"A wife was divorced from her husband. The wife and the husband had a daughter…","config":"all","split":"test","body":"{\"choices\":\"[\\\"granted, because the seizure violated the husband's right of privacy.\\\", 'granted, because the police failed to secure a search warrant before the seizure of the cocaine.', 'denied, because the initial seizure was made by a private individual.', 'denied, because the husband left the briefcase in the kitchen in plain view.']\",\"question\":\"A wife was divorced from her husband. The wife and the husband had a daughter who was 12 years of age. The daughter lived with the wife, but the husband frequently visited his daughter at her house. One morning, the husband came to his ex-wife's home to see his daughter. He and his daughter were outside on the patio chatting when the wife noticed her ex-husband's briefcase lying on the kitchen floor. The husband had entered the house carrying his briefcase, which he placed down before going out to see his daughter on the patio. Seeing the briefcase, the wife decided to open it. Inside she found a large envelope. She decided to keep it, thinking it contained money. Later that night after her ex-husband left, she opened the envelope and found a large amount of cocaine. The wife called the police who came and confiscated the drugs. The husband was subsequently charged with possession of cocaine. The husband has filed a motion to exclude the cocaine from being introduced into evidence. His motion should be\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}