{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5caeae10-406a-5512-98bf-cdbb19c00837","task_key":"all--test--5caeae10-406a-5512-98bf-cdbb19c00837","task_revision_id":"1","upstream_id":"","short_description":"Which statement best describes the relationship between realist international…","config":"all","split":"test","body":"{\"choices\":\"['Both peace researchers and realists advocated an academic focus on the escalation of the arms race. Although tensions existed between the groups in terms of their proposed solutions to this crisis, there existed a consensus that the Soviet bloc should be eliminated as a nuclear threat, thus favouring the survival of Western liberal democracies.', 'In contrast to the realist school, peace researchers looked beyond the accumulation of nuclear weapons for a focus to their studies; this resulted in tensions between the two groups, with the former believing that the attainment of superior military strength was paramount to achieving security.', 'Whilst peace researchers indentified the escalation of the arms race as a result of failures by the League of Nations, realist scholars deemed it to be the natural progression of ideological differences between the Soviet bloc and Western liberal democracies. This resulted in irreconcilable differences between the study agendas of realists and peace researchers.', 'The East-West divide of the Cold War gave rise to a sharp divide between realists and early peace studies theorists. Whilst realists wished to focus research on that which would favour the survival of Western liberal democracies, advocates of peace studies regarded this approach as being narrow and Western ethnocentric.']\",\"question\":\"Which statement best describes the relationship between realist international relations theorists and peace researchers in the early 1960s?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}