{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3d2124bb-a0af-5f0e-a2f5-24f1b5c2a678","task_key":"default--test--5508","task_revision_id":"1","upstream_id":"5508","short_description":"Which of the following statements best describes the characteristics of a weak…","config":"default","split":"test","body":"{\"category\":\"other\",\"options\":\"['Weak states are characterized by a high level of social-political cohesion and a strong monopoly over the instruments of violence. The regime is often legitimized through the use of force.', 'Weak states have a well-developed bureaucracy and are able to enforce their policies through a cohesive social-political structure. They often rely on the legitimacy of the regime to maintain control.', 'Weak states possess high levels of social-political cohesion which is correlated to the hegemonic enforcement idea of the regime, which in turn becomes accepted to the point of being legitimized as the social norm.', 'Weak states have strong military capabilities and maintain absolute loyalty from the armed forces. They frequently intervene in social matters to maintain control.', \\\"Weak states do not utilize coercive capabilities in normal policy. State institutions typically have a developed bureaucracy which legitimizes the regime's ability to rule. Paradoxically, however, the more a weak state exercises its coercive power the more it reinforces its infrastructural power but reduces its ability to rule.\\\", \\\"Weak states have a monopoly on the instruments of violence and have the coercive capability to force compliance even when social actors attempt to resist. The regimes lack popular legitimacy, the integrity of the regime's survival is consolidated by power resulting in the naturalization of violence within society.\\\", 'Weak states have a monopoly over social actors and are able to maintain control through the use of force. They also have well-equipped and well-managed armed forces.', 'The most important characteristics of weak states are their frequent inability to establish and maintain a monopoly of control over the instruments of violence. Even within states with well developed coercive power they do not always retain absolute loyalty and are faced with a real possibility of military intervention. Whilst armed forces are ill-equipped, poorly managed and prone to factional divisions, social actors are powerful enough to resist governance. Therefore, monopoly over the instruments of violence is infrequent.']\",\"question\":\"Which of the following statements best describes the characteristics of a weak state?\",\"src\":\"ori_mmlu-security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}