{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6793abe8-ad5b-575e-95f5-7005f7757c1c","task_key":"all--test--6793abe8-ad5b-575e-95f5-7005f7757c1c","task_revision_id":"1","upstream_id":"","short_description":"In theorising the Responsibility to Protect, fundamental questions are raised…","config":"all","split":"test","body":"{\"choices\":\"['In order to legitimise the inter-state interventions required by R2P, Westphalian notions of sovereignty are invoked, specifically the idea that intervention is required to assure international security.', 'In order to transcend the intervention-vs.-sovereignty debate, R2P seeks a new definition of sovereignty.', 'In order to facilitate the deployment of effective humanitarian intervention, the R2P approach redefines the traditional Westphalian conception of sovereignty.', 'The notion conceptualised by the R2P approach is of a sovereignty that is intrinsically linked with responsibilities and the duty to protect the interests of citizens.']\",\"question\":\"In theorising the Responsibility to Protect, fundamental questions are raised about the nature of state sovereignty. Regarding this tension between R2P and notions of sovereignty, which of the following is not an accurate statement?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}