{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"be477bdb-41ce-5b7f-bb6f-eaea489e014d","task_key":"all--test--be477bdb-41ce-5b7f-bb6f-eaea489e014d","task_revision_id":"1","upstream_id":"","short_description":"What has been the effect of biological weapons on national security in the…","config":"all","split":"test","body":"{\"choices\":\"['The West, notably Canada, Britain, and the US, have conducted research into the weaponization of Anthrax, Tularemia, Q-fever, Venezuelan equine encephalitis, and anti-agricultural agents. However biological weapons were generally viewed in the West as lacking military utility. Instead strategists have concentrated on nuclear and conventional capabilities.', 'The Soviet Union carried out the most extensive research program into genetic engineering to weaponize naturally occurring diseases. However, the Soviets most likely saw their biological weapons program as a counter to the global-strike complex that was emerging in NATO in the 1970s or as a way to inhibit recovery in a nuclear exchange. Biological weapons programs should therefore be regarded in a Cold War context.', \\\"Biological weapons make use of living organisms or toxins to weaken or kill, but because these organisms and toxins occur in nature it makes it difficult to differentiate between naturally occurring disease and subversive activities which, moreover, make a state's capacity hard to verify.\\\", 'All of these options.']\",\"question\":\"What has been the effect of biological weapons on national security in the international community?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}