{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9400898f-4b91-5090-af16-f724ea39b1dd","task_key":"all--test--9400898f-4b91-5090-af16-f724ea39b1dd","task_revision_id":"1","upstream_id":"","short_description":"What is distinguishable about security studies theory?","config":"all","split":"test","body":"{\"choices\":\"['Security studies theory refers to the historical systematic distinction between strategic studies and security studies and the interrelation between general International Relations (IR) theory, security studies, and security theory.', 'The centre of the security studies debate has been to give form to policy questions - strategy, economy of defence, decision making - and to the systematic division of labour that has governed those distinctions.', 'Security theory is a specific subset of security studies and one whose development has gone through distinctive phases and divided more strongly than comparable fields, often without mutual recognition.', 'Security debates structured scholarship centred on offensive versus defensive realism, the relative importance of ideational variables and the role of power and institutions in orders and empires.']\",\"question\":\"What is distinguishable about security studies theory?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}