{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3ec215dc-a215-5a93-a944-2e7c8c50a4aa","task_key":"all--test--3ec215dc-a215-5a93-a944-2e7c8c50a4aa","task_revision_id":"1","upstream_id":"","short_description":"Which of the following best describes what is meant by security in the…","config":"all","split":"test","body":"{\"choices\":\"[\\\"'A nation is secure to the extent to which it is not in danger of having to sacrifice core values if it wishes to avoid war, and is able, if challenged, to maintain them by victory in such a war.' Lippman, W.\\\", \\\"'Security itself is a relative freedom from war, coupled with a relatively high expectation that defeat will not be a consequence of any war that should occur.' Bellamy, M.\\\", \\\"'Emancipation is the freeing of people (as individuals and groups) from the physical and human constraints which stop them carrying out what they would freely choose to do . . . Security and emancipation are two sides of the same coin. Emancipation, not power or order, produces true security. Emancipation, theoretically, is security.' Booth, K.\\\", 'None of the above']\",\"question\":\"Which of the following best describes what is meant by security in the contemporary world, according to the field of Security Studies?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}