{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ea536ee6-3e1b-591c-8d0e-1f2551bf6e93","task_key":"default--test--5513","task_revision_id":"1","upstream_id":"5513","short_description":"Which statement best describes the circumstances that have shaped the emergence…","config":"default","split":"test","body":"{\"category\":\"other\",\"options\":\"['Peace studies developed after the Second World War as a response to the failure of International Relations to prevent global conflict following World War I. Initially, the field was conditioned by the nuclear arms race and East-West divide that characterised the Cold War, but was quick to embrace environmental concerns and the issues surrounding the North-South wealth/poverty divide.', 'Peace studies developed during the 1960s and 1970s as a reaction to the civil rights movement and anti-war protests, focusing on social justice issues and the role of nonviolent resistance in promoting peace.', 'Developed as a response to World War I, peace studies focuses on disparities in wealth and resource allocation that exist within the global system, with the aim of promoting peace through the equal distribution of these resources.', 'The field of peace studies emerged during the Cold War, primarily focusing on the East-West divide and the potential for nuclear war, with a secondary focus on the impact of war on the environment.', 'Peace studies emerged as a field of research in the post-Cold War era, largely driven by the need to understand and address the root causes of internal conflicts and civil wars.', 'Developed during the era of decolonization, peace studies focuses on the legacy of colonialism and its impact on conflicts and tensions in the global South.', 'Peace studies developed as a discipline following the Cold War when the security studies paradigm shifted to include areas of concern such as environmental, societal and economic security. As a field of research peace studies adopts a Euro-centric approach to security and has thus been defined by developments within the West and wealthier nations.', 'Peace studies emerged as a response to the developing nuclear capability of states during the Cold War. The aim of peace studies is to secure the state as a referent object and does this through the study of weapons accumulation. The approach is particularly focused on the nuclear arms race between East and West.', 'Peace studies emerged in the aftermath of the Vietnam War, primarily focusing on the issues surrounding war atrocities and the impact of war on civilian populations.']\",\"question\":\"Which statement best describes the circumstances that have shaped the emergence of peace studies as a field of research?\",\"src\":\"ori_mmlu-security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}