{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bd891190-42e3-58ac-a9c5-6c1c8050d6a7","task_key":"default--test--5943","task_revision_id":"1","upstream_id":"5943","short_description":"What problems has the post-Cold War security literature revealed on women, war,…","config":"default","split":"test","body":"{\"category\":\"other\",\"options\":\"[\\\"Technological advancements have to some extent rendered the battlefield gender-neutral. 'Virtual' warfare has resolved the historical tension between the citizen and the state security apparatus; if actual combat could be avoided then male and female soldiers could wage war on equal terms. However, technological advancement remains unequal and so the gender situation is different in different contexts, depending on development and security issues.\\\", \\\"The technological capacity to wage war with minimal civilian costs has abolished the threat of physical and biological gender victimization. The contemporary gender divide is structured on 'soft' issues associated with socio-economic hardship.\\\", \\\"Conflict in warfare and the gender divide between men and women is centred on the historical contract between the individual and the state. The 'right to fight' debate has equal meaning and saliency across the globe, and is universally applicable in all situations.\\\", 'Nuclear armaments and the threat of mass destruction have rendered the battlefield gender neutral in terms of its destructive capabilities. Whilst historically conventional warfare was conducted on the battlefield in which women were particularly vulnerable to violence, and post-conflict sexual violence, these threats no longer exist.']\",\"question\":\"What problems has the post-Cold War security literature revealed on women, war, development, and security?\",\"src\":\"ori_mmlu-security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}