{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2e6491d0-fe47-53da-b80b-2324c29807f0","task_key":"all--test--2e6491d0-fe47-53da-b80b-2324c29807f0","task_revision_id":"1","upstream_id":"","short_description":"In what ways may weak states be challenged externally?","config":"all","split":"test","body":"{\"choices\":\"[\\\"Powerful states may employ diplomatic pressures to ensure that weak states comply with international norms. This may involve economic sanctions and withholding weaponry deals, which undermines the state's ability to pay or supply the army which increases the risk of army disaffection and possible coups.\\\", 'Weak states are threatened by the proliferation of small arms which can be used in a challenge to the authority of the state. Small and light weapons are purchasable through legal and illegal channels and are prevalent in regions with warlords, criminals and private militias.', 'Weak states cannot remain isolated from processes of globalization. Increasingly porous borders lead to migration and immigration. In order to compete in a globalized market weak states look to secure financial-credit assistance or aid from international institutions. However, these processes undermine the hegemonic idea of the state and societal identity is blurred which makes it difficult for the state to sustain its ideological appeal.', 'All of these options.']\",\"question\":\"In what ways may weak states be challenged externally?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}