{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"948d9d76-d602-56b7-9472-ec7abf1bcd24","task_key":"default--test--5942","task_revision_id":"1","upstream_id":"5942","short_description":"Which of the following is not a purported limitation of the liberalist approach?","config":"default","split":"test","body":"{\"category\":\"other\",\"options\":\"['The liberalist approach does not account for the unpredictability of human nature in decision-making processes.', 'Liberalism overemphasizes the role of democracy in ensuring peace.', 'Liberalist approach fails to acknowledge the role of power politics in international relations.', 'Liberalism fails to provide a clear solution to issues of global inequality.', 'Liberalism ignores the importance of cultural and historical contexts in international relations.', 'Liberalism poses great difficulty in defining when the use of force would be justified or necessary.', 'A failure to address the importance of a wide range of actors in the decision-making processes of the international system.', 'Liberalist influence merely reflects Western dominance, potentially undermining its relevance in the future.', 'Liberalism is often internally inconsistent, limiting its applicability for use as a guide.']\",\"question\":\"Which of the following is not a purported limitation of the liberalist approach?\",\"src\":\"ori_mmlu-security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}