{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f0caf0cf-bd96-58ef-966a-e55cf5d4b933","task_key":"default--test--5866","task_revision_id":"1","upstream_id":"5866","short_description":"Which of these statements is not applicable to the development of peace studies…","config":"default","split":"test","body":"{\"category\":\"other\",\"options\":\"['Peace studies sought to provide a more global and non-state centric view of major issues of conflict.', \\\"At the height of the Cold War, peace studies was frequently labelled 'appeasement studies' and was bitterly opposed by critics.\\\", 'Peace studies in the twentieth century focused solely on the prevention of nuclear warfare.', 'The development of peace studies was largely influenced by the rise of feminism in the late twentieth century.', 'Within peace studies, one of the later developments was a major interest in conflict prevention, conflict resolution, and peacekeeping.', 'The development of peace studies was not affected by the events of the Cold War.', 'By the 1970s, prominent peace researchers were calling for a broadening in the remit of the field but were largely unsuccessful in their attempts.', 'By the end of the twentieth century, peace studies had become a universally accepted academic discipline.']\",\"question\":\"Which of these statements is not applicable to the development of peace studies in the twentieth century?\",\"src\":\"ori_mmlu-security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}