{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0e59ca44-caa0-52d7-9733-f56ce86e8fdb","task_key":"all--test--0e59ca44-caa0-52d7-9733-f56ce86e8fdb","task_revision_id":"1","upstream_id":"","short_description":"What is the significance of anarchy to the realist explanation of international…","config":"all","split":"test","body":"{\"choices\":\"['Anarchy means that the state exists as part of society being indistinguishable from national government and the domestic character of the state.', 'Anarchy refers to the lack of over-arching power in the international system - there is no controlling power beyond the multiple states. In the absence of such authority, states have their own agenda for achieving security, and can determine their own goals and behaviour.', \\\"Anarchy means that there is little continuity in a government's foreign policy over time. Leaders come and go and their foreign policy changes, which is reflective of different preoccupations and ideologies.\\\", 'Anarchy means that the structure of the international system is distinctive because states have a strong sense that they are part of a larger entity in international politics with overarching interests and goals, making association unlimited and important.']\",\"question\":\"What is the significance of anarchy to the realist explanation of international politics?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}