{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1d4af91e-c1d7-5e95-8894-132e8846410f","task_key":"all--test--1d4af91e-c1d7-5e95-8894-132e8846410f","task_revision_id":"1","upstream_id":"","short_description":"In what ways is gender applicable to the field of Security Studies?","config":"all","split":"test","body":"{\"choices\":\"['Women and children are dependent on the state for protection and Security Studies should include them and account for their needs.', 'Biological differences between men and women determine their suitability for different roles in protecting the state or referent object.', \\\"Gender is not applicable to Security Studies - to create a 'gender neutral' security arena we should disregard gender issues.\\\", \\\"Social constructions of 'masculinity' or 'femininity' determine the roles in which men and women are expected to act, by considering these artificial roles we can ask important questions about the ways in which we conceptualize security.\\\"]\",\"question\":\"In what ways is gender applicable to the field of Security Studies?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}