{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3686fbcb-a2ab-5ed7-986d-e8c32ee69f83","task_key":"all--test--3686fbcb-a2ab-5ed7-986d-e8c32ee69f83","task_revision_id":"1","upstream_id":"","short_description":"Are strategies of Arms Control and Deterrence useful in cyber-security?","config":"all","split":"test","body":"{\"choices\":\"['No, arms control does not serve any purpose outside the realm of traditional military weapons.', 'Yes, successful policies of arms control and deterrence have translated well from other security realms, such as nuclear weapons control strategies.', 'Effective deterrence requires international cooperation which is achievable in theory, but the verification required for traditional arms control strategies is impossible in cyber(ed) warfare.', 'Only arms control is unproblematic, deterrence has failed because international cooperation cannot be reached and common rules or practices cannot be established.']\",\"question\":\"Are strategies of Arms Control and Deterrence useful in cyber-security?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}