{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"317257f0-d031-5fd7-a9bf-7b04306029dc","task_key":"all--test--317257f0-d031-5fd7-a9bf-7b04306029dc","task_revision_id":"1","upstream_id":"","short_description":"Which of the following are economic objectives of IMF adjustment policies?","config":"all","split":"test","body":"{\"choices\":\"['Devaluation to promote exports and reduce demand for imports by raising their prices.', 'Tighter monetary and credit policies with higher interest rates to reduce overall demand, and thus demand for imports; to limit or reduce the rate of inflation.', 'All of these options.', 'Public spending cuts to reduce the budget deficit and slow the growth of government debt.']\",\"question\":\"Which of the following are economic objectives of IMF adjustment policies?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}