{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4035bfef-80b3-58f1-83d6-4aad81a032e0","task_key":"all--test--4035bfef-80b3-58f1-83d6-4aad81a032e0","task_revision_id":"1","upstream_id":"","short_description":"How can we best describe liberalism?","config":"all","split":"test","body":"{\"choices\":\"['Liberalism is a fundamentally pessimistic approach that regards the international system as destined to the escalation of conflict. It is the dominant conception in the practice of international politics.', 'Liberalism is a novel conception in the theory of international politics. It is an optimistic approach that defines the ways in which states should relate to one another, particularly during conflict situations.', 'Liberalism is an optimistic approach, offering an orientation for the better conduct of international affairs in the belief that a more peaceful world is possible. It is the dominant conception in the practice of international politics.', 'Liberalism does not exist as a mainstream theory within International Relations, but rather offers a set of guidelines and advice for states and political actors wishing to accrue power within the international system independently from the restrictions of traditional security paradigms.']\",\"question\":\"How can we best describe liberalism?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}