{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"100039f6-f38e-5ed9-8f31-6260d3dfb1d3","task_key":"all--test--100039f6-f38e-5ed9-8f31-6260d3dfb1d3","task_revision_id":"1","upstream_id":"","short_description":"What is the future of WMD?","config":"all","split":"test","body":"{\"choices\":\"['The viability of the CWC and BCW providing a concrete basis in international law to prevent the proliferation of chemical and biological weapons is dubious. The Proliferation Security Initiative to prevent the illicit trade in materials relating to chemical and nuclear weapons is an equally piecemeal pursuit. Whilst they may serve some utility as a framework for diplomatic exchanges, they are essentially toothless bodies lacking the political will to establish an authority with the powers to police the control and use of these weapons.', \\\"The International Non-proliferation Regime has been rendered effectively defunct in the post-Cold War climate. State actors seeking to develop their own weapons capabilities have de-stabilized norms governing the use and control of WMD. This has been evidenced by severe splits in the body following the 1998 Indian and Pakistani nuclear testing and the withdrawal of great power support following the US Senate's decision not to ratify the Comprehensive Test Ban Treaty.\\\", 'Contemporary concern has been pacified by the fact that WMD threat has greatly diminished with the end of the Cold War. A number of deployed Soviet (Russian) and strategic warheads and US tactical nuclear weapons have been withdrawn from service thereby removing the threat of total war by massive nuclear exchange.', \\\"WMD terrorism poses a security threat that is not easily met by today's policy community or military establishments. The second strike rule is virtually obsolete because of the difficulty of locating such groups and deterrence is an unviable strategy given that objective of attacks are frequently politically, ideologically or religiously motivated.\\\"]\",\"question\":\"What is the future of WMD?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}