{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5367ee15-84de-5e37-bc42-edb9b874d968","task_key":"all--test--5367ee15-84de-5e37-bc42-edb9b874d968","task_revision_id":"1","upstream_id":"","short_description":"Which of the following is a predictable advantage of expansionary monetary…","config":"all","split":"test","body":"{\"choices\":\"['Decreases aggregate demand so that the price level falls.', 'Increases aggregate demand which increases real GDP and increases employment.', 'Increases unemployment but low prices negate this effect.', 'It keeps interest rates high which attracts foreign investment.']\",\"question\":\"Which of the following is a predictable advantage of expansionary monetary policy in a recession?\",\"subject\":\"high_school_macroeconomics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}