{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5b1e654a-e9b4-5c51-a8bd-d90538895aa3","task_key":"all--test--5b1e654a-e9b4-5c51-a8bd-d90538895aa3","task_revision_id":"1","upstream_id":"","short_description":"What are the effects of nuclear weapons?","config":"all","split":"test","body":"{\"choices\":\"['A nuclear blast produces EMP, a thermal light pulse, blast, and fallout at the moment of detonation. The electro-magnetic pulse occurs when gamma radiation interacts with matter (the atmosphere), \\\"the Compton effect.\\\" EMP produces a high voltage charge, harmless to humans but destructive to electronic systems. EMP effects are maximized at high altitude. However thermal-light pulse can produce flash blindness, retinal burn, and fire whilst the airburst can cause severe skin burns.', 'A nuclear detonation produces a shockwave resulting from a rise in atmospheric pressure and dynamic overpressure sufficient to destroy concrete structures. Blast effects were generally used by military planners to calculate casualty rates in a nuclear attack: It was estimated that 50 percent living in a five mile radius of a one-mgt airburst would be killed or wounded by blast effects.', 'Nuclear reactions in the initial nuclear detonation or the fallout can cause radiation poisoning, as irradiated debris is picked up by the nuclear fireball and lofted into the atmosphere. A dirty bomb uses chemical high-explosive to disperse radioactive material, relying on radiation to produce a lethal effect. Panic set off by even a limited dispersion of radioactive material might be more costly in terms of the disruption it causes than actual casualties or damage to property produced by a dirty bomb detonation; some observers believe that the blast itself causes the greatest amount of damage.', 'All of the above']\",\"question\":\"What are the effects of nuclear weapons?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}