{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"584aaf8d-8c84-55ee-a0d6-796399821af5","task_key":"all--test--584aaf8d-8c84-55ee-a0d6-796399821af5","task_revision_id":"1","upstream_id":"","short_description":"How has HM developed during and since the Cold War?","config":"all","split":"test","body":"{\"choices\":\"['During the post Cold War period there has grown an increasingly disparity between the analytical framework of security studies and HM, sidelining the latter and excluding it from mainstream study.', 'Following the popularity of HM during the Cold War it has enjoyed a gradual inclusion into security dialogue and is now considered one of the main paradigms within security studies.', 'The negativity attached to HM during the Cold War restricted the prominence of HM at this time, excluding it from mainstream security studies. Following this, the broadening of the security studies agenda has lead to increasing inclusion of HM as an area for study.', 'HM was developed as an approach to security studies following the Cold War and has flourished in the proceeding security environment. It has also enjoyed reputable success thanks to its affiliation with prominent actors during the Cold War.']\",\"question\":\"How has HM developed during and since the Cold War?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}