{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"07099e06-6f33-56b3-bd08-82f291ebf152","task_key":"all--test--07099e06-6f33-56b3-bd08-82f291ebf152","task_revision_id":"1","upstream_id":"","short_description":"What are the practical problems associated with applying coercive diplomacy in…","config":"all","split":"test","body":"{\"choices\":\"[\\\"Different natures of the adversaries complicate the use of Western coercion. Their tendency to rely on irregular or asymmetric military strategies makes it hard to threaten or even defeat their opponent's military strategy. Those actors deny forces the ability to win quickly with little cost.\\\", 'Increased verification capabilities brought in with the technological and communication revolution have resulted in a practical difficulty for practitioners, enabling the verification of tactical/temporary and strategic/lasting - only the latter of which constituting a compliance success. The capacity to verify processes have highlighted instances of non-compliance following inconclusive coercive diplomacy exchanges.', 'Coalitional coercive diplomacy is the only credible means for Western democracies to gain the sincerity required to make a threat of force real in the mind of the adversary. However, past efforts of coalitional building have proved to be extremely limited. Disagreements over the means and coordination of the policy often result in splits and consequently states are reluctant to employ it. Where it has been employed it collapses under the weight of its own inadequacy.', 'All of these options.']\",\"question\":\"What are the practical problems associated with applying coercive diplomacy in the West?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}