{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2ddeba4c-5cd7-57bf-b43a-f6835bb7abb0","task_key":"all--test--2ddeba4c-5cd7-57bf-b43a-f6835bb7abb0","task_revision_id":"1","upstream_id":"","short_description":"A man, his brother and his friend all discuss murdering the man's neighbor…","config":"all","split":"test","body":"{\"choices\":\"['The man and his brother have committed criminal conspiracy and attempted murder.', 'The man and his brother are guilty of conspiracy but not attempted murder.', 'The man and his brother are guilty of conspiracy and attempted murder, but the friend is guilty of nothing.', 'The man and his brother are guilty of conspiracy and attempted murder, and the friend is guilty of criminal conspiracy.']\",\"question\":\"A man, his brother and his friend all discuss murdering the man's neighbor because the neighbor took some shots at the man's dog but he missed. They agree on a plan. They decided on strychnine poisoning, which the friend told them how to get and they went and got it. When they asked the friend to go forward in poisoning the victim, he refused, saying, \\\"I'm was only here for planning and advice, but I never intended to commit murder.\\\" The man and his brother took the poison to a meeting with the neighbor, but he wouldn't drink. They were caught and arrested. The statute requires an overt act for criminal conspiracy. Which of the following most accurately states the criminal responsibility of each of the three men?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}