{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3b10ca5e-11db-5e95-802d-742fa89488c2","task_key":"all--test--3b10ca5e-11db-5e95-802d-742fa89488c2","task_revision_id":"1","upstream_id":"","short_description":"Which of the following statements is true within the postcolonial approach?","config":"all","split":"test","body":"{\"choices\":\"['The international system is shaped through colonised discourse that establishes notions of certain states as inferior to others.', 'European practices of free trade and democracy are best suited to creating a peaceful and stable international system.', 'With the end of the Second World War and gradual dissolution of the British Empire, much of postcolonialism is redundant.', 'Colonial power exists only through the military actions of occupying states.']\",\"question\":\"Which of the following statements is true within the postcolonial approach?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}