{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5a59b2f8-6a0f-5db5-8a27-03dfa99b0290","task_key":"all--test--5a59b2f8-6a0f-5db5-8a27-03dfa99b0290","task_revision_id":"1","upstream_id":"","short_description":"What are the main criticisms of the realist argument against humanitarian…","config":"all","split":"test","body":"{\"choices\":\"['Realist opposition to humanitarian intervention is based on assumptions that states will protect their citizens.', 'The realist position overlooks the responsibilities that are inherent to sovereignty.', 'Critics of humanitarian intervention overlook the wide body of international law relating to basic human rights and the consensus on grave crimes such as genocide.', 'All of these options.']\",\"question\":\"What are the main criticisms of the realist argument against humanitarian intervention?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}