{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8a1f5382-c318-5d29-9fd9-8068a71655b1","task_key":"all--test--8a1f5382-c318-5d29-9fd9-8068a71655b1","task_revision_id":"1","upstream_id":"","short_description":"In what ways may the security dimensions of infectious disease be considered in…","config":"all","split":"test","body":"{\"choices\":\"['The physical health of armed forces is a paramount concern within the traditional security paradigm, and the threat of disease is exacerbated by the physical and sociological conditions under which military personal operate, particularly during combat.', 'The innate human fear of microbes makes them particularly amenable to being portrayed not just as important health issues, but as national-security threats as well.', 'Diseases that traditionally affect certain regions of the world, due to their epidemiologic nature or for socio-economic reasons, are increasingly perceived by national governments as potential threats as a result of globalisation.', 'All of these options.']\",\"question\":\"In what ways may the security dimensions of infectious disease be considered in the national security framework?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}