{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"df40752a-2ad8-51f6-b9ce-be6b495e8657","task_key":"default--test--5078","task_revision_id":"1","upstream_id":"5078","short_description":"Are strategies of Arms Control and Deterrence useful in cyber-security?","config":"default","split":"test","body":"{\"category\":\"other\",\"options\":\"['No, arms control does not serve any purpose outside the realm of traditional military weapons.', 'Arms control strategies can be implemented, but deterrence strategies are impossible due to the anonymous nature of cyber attacks.', 'Yes, both strategies are effective in cyber-security as long as there is strong international cooperation and regulation.', 'Effective deterrence requires international cooperation which is achievable in theory, but the verification required for traditional arms control strategies is impossible in cyber(ed) warfare.', 'Only arms control is unproblematic, deterrence has failed because international cooperation cannot be reached and common rules or practices cannot be established.', 'Both strategies can only work if there is a clear agreement on what constitutes a cyber weapon and what constitutes a cyber attack.', 'Yes, successful policies of arms control and deterrence have translated well from other security realms, such as nuclear weapons control strategies.', 'Deterrence is ineffective because it encourages an arms race in cyberspace, while arms control is difficult due to the ease of creating and distributing cyber weapons.', 'Both arms control and deterrence strategies are ineffective due to the rapid and unpredictable development of cyber warfare technologies.', \\\"No, both strategies are obsolete in the face of cyber warfare's unique challenges such as attribution and boundary issues.\\\"]\",\"question\":\"Are strategies of Arms Control and Deterrence useful in cyber-security?\",\"src\":\"ori_mmlu-security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}