{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"164627a5-8e06-5c96-87ca-996136ddeaeb","task_key":"all--test--164627a5-8e06-5c96-87ca-996136ddeaeb","task_revision_id":"1","upstream_id":"","short_description":"Which statement best describes the liberalist attitude towards international…","config":"all","split":"test","body":"{\"choices\":\"['Liberalism holds that international organisations can enhance national and international security. It advocates the inclusion of non-governmental organisations and other actors to encourage cooperation and build communities.', 'The liberalist advocacy of cooperation as enhancing security is undermined by the failure of international organisations such as the league of nations in preventing global conflicts.', \\\"Under liberalism's different schools of thought, there is a general consensus that the involvement of international organisations in the political system ultimately undermines security by disempowering the state as a unitary actor.\\\", 'All of these options.']\",\"question\":\"Which statement best describes the liberalist attitude towards international organisations?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}