{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5dcb405a-4d7b-56f7-bd77-2dacea67075f","task_key":"default--test--5507","task_revision_id":"1","upstream_id":"5507","short_description":"Which of these statements cannot be applied to the initial development of peace…","config":"default","split":"test","body":"{\"category\":\"other\",\"options\":\"['Peace studies was initially not recognized as a legitimate academic discipline.', 'The initial development of peace studies was greatly influenced by the political climate of the Cold War era.', 'Mathematicians and natural scientists entered the field, which was otherwise a social-sciences area of study, adding to the interdisciplinary nature of the field.', 'The field of peace studies was initially developed by historians and anthropologists.', 'Most early work was carried out in North America and Scandinavia.', 'Early peace studies were primarily conducted by government agencies.', 'The establishment of research institutes across the world has been one of the lasting successes of peace studies.', 'Now of fundamental importance to peace studies as a field of research, the creation of journals was not a prominent feature of the peace studies until late in the twentieth century.']\",\"question\":\"Which of these statements cannot be applied to the initial development of peace studies?\",\"src\":\"ori_mmlu-security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}