{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a4a6b07c-4204-50a4-92ef-d794f1607c77","task_key":"default--test--5369","task_revision_id":"1","upstream_id":"5369","short_description":"According to Buzan, Waever, and de Wilde, in what ways does the Copenhagen…","config":"default","split":"test","body":"{\"category\":\"other\",\"options\":\"['The theory and knowledge that underpin each approach are fundamentally at odds with one another. Whilst Critical Security Studies is post-structuralist and constructivist, the Copenhagen School is based on an objectivist epistemology.', 'Whilst Critical Security Studies regards security to be a social construction, based on the changeable ideas that form human society, the Copenhagen school disregards this epistemological approach and instead considers security as an issue to be studied objectively from a positivist approach.', 'Critical Security Studies regards security to be an empirically definable state, which should be studied from a positivist approach. However, the Copenhagen School views security as a socially constructed entity that denies the validity of an objective approach.', 'Neither Critical Security Studies nor the Copenhagen School account for the changing nature of society and its impact on the construction of security.']\",\"question\":\"According to Buzan, Waever, and de Wilde, in what ways does the Copenhagen School's approach to Security Studies differ from that of Critical Security Studies?\",\"src\":\"ori_mmlu-security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}