{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b3b159c8-6286-5bea-83e8-536c5512af59","task_key":"default--test--5590","task_revision_id":"1","upstream_id":"5590","short_description":"What are the themes that make post-structuralism a different field of study and…","config":"default","split":"test","body":"{\"category\":\"other\",\"options\":\"['One of the founding assumptions of Critical Security Studies is that theories about the world constitute that world and thus that theory, including security theory, has political effects. The consequence is that theory is the product of the system, and that analyses of the agent of security and the referent object is produced by its own practices.', 'Central to the political and critical nature of post-structural literature is the idea of fostering an ethos of democracy and an ethos of critique which is finite and attainable. It is to this end that we must strive, but one that can only be met under the conditions prescribed, that of true democracy.', 'Poststructuralism accepts the form and foundations for knowledge claims that dominate the security studies debate. This has brought it into confrontation with the critical studies community, having little to contribute to the understanding of the ways in which knowledge is constructed.']\",\"question\":\"What are the themes that make post-structuralism a different field of study and why is it criticized?\",\"src\":\"ori_mmlu-security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}