{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"094df945-97b8-5905-84bc-54ecebccf4f4","task_key":"all--test--094df945-97b8-5905-84bc-54ecebccf4f4","task_revision_id":"1","upstream_id":"","short_description":"Which of the following is evidence that de Marneffe cites in support of the…","config":"all","split":"test","body":"{\"choices\":\"['Heroin use was much higher among military personnel in Vietnam than it was among veterans who returned to the United States.', 'The percentage of physicians who use psychoactive drugs is much higher than the general population.', 'Alcohol abuse declines when the law restricts the times it can be legally sold.', 'all of the above']\",\"question\":\" Which of the following is evidence that de Marneffe cites in support of the claim that increased availability of a drug leads to increased use of that drug?\",\"subject\":\"moral_disputes\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}