{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"02970046-b739-5944-b609-7498905b3e57","task_key":"all--test--02970046-b739-5944-b609-7498905b3e57","task_revision_id":"1","upstream_id":"","short_description":"Which of the following is not an assertion made in the realist case against…","config":"all","split":"test","body":"{\"choices\":\"['Armed force should only ever be used in the national interest and that humanitarian intervention is therefore imprudent.', 'Foreign intervention reduces the proportion of wars that end in outright victory, it leaves behind an unstable peace that is likely to reignite.', 'Foreign intervention tends to prolong wars; it is inappropriate and does not work.', 'Humanitarian intervention prioritises the human as the referent object of security, undermining the state-centric approach of realism.']\",\"question\":\"Which of the following is not an assertion made in the realist case against humanitarian inventions?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}