{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1523bdd6-76d7-5a33-97ed-b09fda5fc05e","task_key":"all--test--1523bdd6-76d7-5a33-97ed-b09fda5fc05e","task_revision_id":"1","upstream_id":"","short_description":"A heroin addict voluntarily entered a residential treatment center. A government…","config":"all","split":"test","body":"{\"choices\":\"['Yes, because this was entrapment in that the intent to commit the crime originated with the government.', 'No, this was not entrapment because the addict was predisposed to want to obtain drugs due to his status as a drug user.', 'No, this was not entrapment because the addict went voluntarily to get the drugs; he could have refused.', 'Yes, this was entrapment because as soon as the agent asked a second time, he had established entrapment under the majority rule.']\",\"question\":\"A heroin addict voluntarily entered a residential treatment center. A government undercover agent introduced himself and struck up a friendship with him. The agent asked the addict to obtain heroin for him, but the addict refused. For several weeks the agent continued to plead with and beg the addict to get him drugs; finally, the addict gave in to the pressure and got the drugs. The police promptly arrested him. At trial, the defendant raised the defense of government entrapment. Will the trial court likely dismiss the case based on that argument?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}