{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"26cca87c-4595-57f9-81a9-17d5631f5da2","task_key":"all--test--26cca87c-4595-57f9-81a9-17d5631f5da2","task_revision_id":"1","upstream_id":"","short_description":"When considering the international system from a realist perspective, which of…","config":"all","split":"test","body":"{\"choices\":\"[\\\"War is more likely to occur when a state is losing power, a decline in a state's ability to protect itself from attack, coercion and vulnerability increases its motivation to engage in aggressive behaviour.\\\", 'War may be more likely to occur in multipolar international systems where, among other reasons, states have the incentive and opportunity to buckpass.', 'War is more likely when the offence-defence balance of the international system favours offence, thus creating a more competitive environment for states.', 'All of these options.']\",\"question\":\"When considering the international system from a realist perspective, which of the following statements concerning the advent of war is true?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}