{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c635af2c-a66c-5751-bbd0-66d9caa10e60","task_key":"all--test--c635af2c-a66c-5751-bbd0-66d9caa10e60","task_revision_id":"1","upstream_id":"","short_description":"Which of the following is applicable when considering the concept of security…","config":"all","split":"test","body":"{\"choices\":\"['For societal security dilemmas ambiguity can stem from two sides of nationalism; cultural (positive) and ethnic (negative). Ethnic (political) nationalism is often described as more malign and linked to state disintegration, whereas cultural nationalism is often seen as benign, working within existing state structures.', 'Clear distinctions between cultural nationalism and political nationalism are difficult to make: cultural nationalism may sometimes be compelled to change itself from a solely cultural movement into a political movement and be conflated with political nationalism.', 'Dominant actors may exaggerate threat perceptions with the intent of mobilizing political support which can result in action reaction processes.', 'All of these options.']\",\"question\":\"Which of the following is applicable when considering the concept of security dilemmas in terms of societal identity?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}