{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c4920576-5460-5e9e-8efd-852ab86684c7","task_key":"all--test--c4920576-5460-5e9e-8efd-852ab86684c7","task_revision_id":"1","upstream_id":"","short_description":"How might global inequality present a threat to global security?","config":"all","split":"test","body":"{\"choices\":\"['Human security is threatened by global inequality, because 3s of the world population do not share the benefits of globalisation. However, this inequality does not translate into political instability or involve military action.', 'Global inequality creates disenfranchised populations who, although discontent with their situation, lack the agency to rebel or protest.', 'Revolutionary uprisings are likely to occur; people of the world who have been left behind by neoliberal globalisation can become radicalised and rebel against those who have benefitted from the economic policies that have failed them.', 'Global inequality does not present a significant threat to global security.']\",\"question\":\"How might global inequality present a threat to global security?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}