{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f3cfb2f1-84ff-5e71-a688-426f0e9bfb7a","task_key":"all--test--f3cfb2f1-84ff-5e71-a688-426f0e9bfb7a","task_revision_id":"1","upstream_id":"","short_description":"Which of the following is an important reason to advocate the process of…","config":"all","split":"test","body":"{\"choices\":\"['To prevent the erosion of established civil liberties through the removal of special rights and the cessation of extraordinary measures.', 'To prevent stagnation of the security realm and facilitate the recognition and securitization of new or more urgent existential threats.', 'To prevent the securitization of irrelevant threats and to challenge the legitimacy of currently securitized threats.', 'To ensure that securitizing actors conceptualise security threats in terms of those that can be addressed using extraordinary measures.']\",\"question\":\"Which of the following is an important reason to advocate the process of desecuritization?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}