{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"124e3e8a-0830-5bf4-9323-ff16ba852a58","task_key":"all--test--124e3e8a-0830-5bf4-9323-ff16ba852a58","task_revision_id":"1","upstream_id":"","short_description":"According to Krause and Williams, what agenda would most likely attract scholars…","config":"all","split":"test","body":"{\"choices\":\"['To question the referent object, to question the traditional conception of military security as paramount to the state, and to change the way in which security is studied.', 'To address security from a positivist perspective, challenging the dominance of traditional security paradigms, and shifting academic attention to the individual as a referent point.', 'To question the dominance of liberalism and realism in the international system, to apply critical knowledge to the security dilemma faced by states and to redress the power imbalances that lead to intra-state conflict.', 'To account for all possible referent objects and expand the definition of security so far as to allow for a broadening of the school to encompass any agent that threatens those referent objects.']\",\"question\":\"According to Krause and Williams, what agenda would most likely attract scholars to the 'broad church' of security studies?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}