{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"67fe1e54-9306-5f3d-b7d6-5ee6f6bcac9d","task_key":"all--test--67fe1e54-9306-5f3d-b7d6-5ee6f6bcac9d","task_revision_id":"1","upstream_id":"","short_description":"What do critics fear would be the result of granting rights of humanitarian…","config":"all","split":"test","body":"{\"choices\":\"['An abuse of this power in order to wage state-interested wars.', 'A depletion of military resources pursuing wars on ethical grounds, leading to a loss of military security.', \\\"Whilst some states have proven their ability to conduct 'just' wars in order to protect sound values of democracy and neoliberalism, not all states would use force to pursue such globally beneficial ends.\\\", 'A lack of implementation of these rights by state actors, leading to a failure to address human rights abuses.']\",\"question\":\"What do critics fear would be the result of granting rights of humanitarian intervention?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}