{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"21de355c-4e14-5d6f-957e-3729da610bc9","task_key":"all--test--21de355c-4e14-5d6f-957e-3729da610bc9","task_revision_id":"1","upstream_id":"","short_description":"In what ways might the effects of chemical weapons affect the decision to deploy…","config":"all","split":"test","body":"{\"choices\":\"['Chemical weapons are a highly complicated means to conduct an assault. The unpredictability of chemicals (the degree of evaporation, stability and concentration) frequently proves to be incommensurate with political objectives.', 'Analysts are concerned with the potential ease of chemical manufacturing. Weapons could be quickly and effectively deployed being light, concealable and rapidly deployed. Most weapons can be delivered in a line source for example a crop duster or administered through an aerosol. Dispersal in areas of poor ventilation or closed venues where people are in close proximity could have potentially catastrophic effects.', 'Chemical weapons have the potential to cause mass casualties. Moderate exposure to chemicals produces serious side effects and would generate serious casualties if weaponized.', 'Wind, temperature and terrain can affect the lethality and persistence of an agent and is dependent on the extensity and degree of contact with the target.']\",\"question\":\"In what ways might the effects of chemical weapons affect the decision to deploy them against a target?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}