{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e91c9804-a27f-514c-8c14-92b60a0a5b26","task_key":"all--test--e91c9804-a27f-514c-8c14-92b60a0a5b26","task_revision_id":"1","upstream_id":"","short_description":"Some governmental regimes are reluctant to fully join the liberalist camp; which…","config":"all","split":"test","body":"{\"choices\":\"['The dominance of Western ideologies can be regarded as contemporary imperialism.', 'Liberalism advocates the enforcement of certain values that are not shared by all political regimes.', 'The fear that cooperation may be recurring.', 'Adherence to liberalism does not guarantee the favoured treatment of state regimes over its citizens; other states may threaten regime security in their efforts to secure societal security.']\",\"question\":\"Some governmental regimes are reluctant to fully join the liberalist camp; which of the following is not a valid reason for this reluctance?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}