{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"62034a66-39ee-53d9-aeb4-0867ccfb7bb4","task_key":"all--test--62034a66-39ee-53d9-aeb4-0867ccfb7bb4","task_revision_id":"1","upstream_id":"","short_description":"A mother has an 11-year-old daughter. The mother is legally separated from her…","config":"all","split":"test","body":"{\"choices\":\"['denied, because the daughter, and husband, as co-owner, had the authority to allow the police inside the home and make the seizure.', 'denied, because the daughter lived with her mother and had equal control over the premises.', 'granted, because the daughter, as a minor, did not have apparent authority to permit the police to enter the home.', \\\"granted, because the daughter did not have apparent authority to permit the police to enter her mother's bedroom.\\\"]\",\"question\":\"A mother has an 11-year-old daughter. The mother is legally separated from her husband and has filed for divorce. The mother and her husband own their home in joint tenancy. One night, the mother went out to dinner and left her daughter at home. Upon leaving the house, the mother locked the door to her bedroom. While the mother was gone, the daughter found a spare key to her mother's bedroom and opened the door. While rummaging through her mother's dresser, she found a bag containing white powder. Concerned that the bag might contain drugs, the daughter called her father to ask his advice. The husband instructed her to call the police. The daughter then telephoned the police station and reported what she had found. A patrol car was immediately dispatched to her home. The daughter allowed the police to come inside and led them to her mother's bedroom. She gave the officers the bag, which they took to the station house for a lab test. After the results confirmed that the bag contained cocaine, the mother was arrested and charged with illegal possession of a controlled dangerous substance. The mother's attorney has filed a motion to prevent the cocaine from being admitted into evidence. The motion should be\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}