{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bbaeb027-0a5a-55a5-a2d7-1451fa3ae917","task_key":"all--test--bbaeb027-0a5a-55a5-a2d7-1451fa3ae917","task_revision_id":"1","upstream_id":"","short_description":"Two men agreed to burglarize a home. While they were planning the burglary, the…","config":"all","split":"test","body":"{\"choices\":\"['The two men are guilty of conspiracy.', 'The two men and the alarm specialist are guilty of conspiracy.', 'The two men are guilty of conspiracy and the two men and the alarm specialist are guilty of attempted burglary.', 'The two men and the alarm specialist are guilty of both conspiracy and attempted burglary.']\",\"question\":\"Two men agreed to burglarize a home. While they were planning the burglary, the two men learned that the home had a sophisticated alarm system that needed to be disarmed. One of the men told the other that he knew an alarm specialist who could help disarm the security system. One of the men then approached the alarm specialist and asked if he would assist them in disarming the home's alarm system. The alarm specialist said that he didn't want to participate in the crime but told the man how he could disarm the system himself. The two men thereafter went to the home to commit the burglary. When they arrived at the home, they saw a vicious guard dog patrolling the fenced-in area of the home. Deciding it would be too risky to confront the dog, the two men abandoned their planned burglary. Which of the following is the most accurate statement regarding the criminal liability of the two men and the alarm specialist?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}