{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d26d8dfd-2996-5700-8a4d-d0908d9090ec","task_key":"all--test--d26d8dfd-2996-5700-8a4d-d0908d9090ec","task_revision_id":"1","upstream_id":"","short_description":"What are the challenges for the future of security studies?","config":"all","split":"test","body":"{\"choices\":\"['The most obvious issue of joint concern during the 2000s was terror and order, although fast- rising concerns over environmental/climate security could easily provide another big linking issue.', 'The fate of security studies depends on its ability to prevail in the general debates in the discipline of IR. It is very unlikely that the internal dynamics of the theory debate will be decided by a general prevalence of one of the current debates.', 'Both the US and European analysts will be working on the role and nature of technology, globalization, risk society and the international economic order. This picture shows that there will be a lot of points of contact between the currently disconnected fields of theory.', 'All of these options.']\",\"question\":\"What are the challenges for the future of security studies?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}