{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7f4ec21c-c4b1-52e9-a788-c3d3f7874ed1","task_key":"default--test--5146","task_revision_id":"1","upstream_id":"5146","short_description":"What was the importance of peace research during the 1980s?","config":"default","split":"test","body":"{\"category\":\"other\",\"options\":\"['Peace research was inter-disciplinary and politically orientated with immediate policy responsibility accountable to the major powers of the political system.', 'There was a distance from policy responsibility but European security studies gained political relevance due to the politicization of security issues during the period defined by the peace movement.', 'The importance of peace research was largely due to its focus on economic stability, rather than political or military issues.', 'The setting was simultaneously informed by political theory as the dominant discipline and isolated from developments in theory in the different disciplines.', 'Peace research was not relevant during the 1980s due to the lack of major conflicts.', 'Peace research was primarily used for the development of military strategies during the period of the Cold War.', 'There was an increased focus on peace research due to the rise in global terrorism.', 'The importance of peace research was diminished as it was seen as too theoretical and not applicable to real-world situations.']\",\"question\":\"What was the importance of peace research during the 1980s?\",\"src\":\"ori_mmlu-security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}