{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"725ea65e-3d24-57b1-9c54-693cd99bffc3","task_key":"all--test--725ea65e-3d24-57b1-9c54-693cd99bffc3","task_revision_id":"1","upstream_id":"","short_description":"According to George and Simons, what factors influence the outcomes of an act of…","config":"all","split":"test","body":"{\"choices\":\"['Global strategic environment; type of provocation; image of war.', 'Unilateral or coalitional coercive diplomacy; isolation of the adversary; clarity of objective; strength of motivation and asymmetry of motivation.', 'Sense of urgency; strong leadership; domestic support; international support; opponents fear of unacceptable escalation; clarity concerning the precise terms of settlement.', 'All of these options. George and Simons distinguish between contextual variables and conditions favouring success, and the idea that they should be used by decisionmakers at different stages in the policymaking process.']\",\"question\":\"According to George and Simons, what factors influence the outcomes of an act of coercive diplomacy?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}