{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ca924935-0db2-5350-8340-8a6b93256f92","task_key":"default--test--5210","task_revision_id":"1","upstream_id":"5210","short_description":"In theorising the Responsibility to Protect, fundamental questions are raised…","config":"default","split":"test","body":"{\"category\":\"other\",\"options\":\"['In order to transcend the intervention-vs.-sovereignty debate, R2P seeks a new definition of sovereignty.', 'In order to facilitate the deployment of effective humanitarian intervention, the R2P approach redefines the traditional Westphalian conception of sovereignty.', 'The notion conceptualised by the R2P approach is of a sovereignty that is intrinsically linked with responsibilities and the duty to protect the interests of citizens.', 'According to R2P, sovereignty is only valid if the state can guarantee the safety and rights of its citizens.', 'In order to legitimise the inter-state interventions required by R2P, Westphalian notions of sovereignty are invoked, specifically the idea that intervention is required to assure international security.']\",\"question\":\"In theorising the Responsibility to Protect, fundamental questions are raised about the nature of state sovereignty. Regarding this tension between R2P and notions of sovereignty, which of the following is not an accurate statement?\",\"src\":\"ori_mmlu-security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}