{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"91ddc9ea-0b86-53f5-9ac0-b54fcf2cadc6","task_key":"all--test--91ddc9ea-0b86-53f5-9ac0-b54fcf2cadc6","task_revision_id":"1","upstream_id":"","short_description":"If a nation is operating at full employment and the central bank engages in…","config":"all","split":"test","body":"{\"choices\":\"['Decrease \\\\xa0\\\\xa0\\\\xa0 Increase \\\\xa0\\\\xa0\\\\xa0 Increase', 'Decrease \\\\xa0\\\\xa0\\\\xa0 Decrease \\\\xa0\\\\xa0\\\\xa0 Decrease', 'Increase \\\\xa0\\\\xa0\\\\xa0 Decrease \\\\xa0\\\\xa0\\\\xa0 Decrease', 'Increase \\\\xa0\\\\xa0\\\\xa0 Decrease \\\\xa0\\\\xa0\\\\xa0 Increase']\",\"question\":\"If a nation is operating at full employment and the central bank engages in contractionary monetary policy the nation can expect the interest rate the purchases of new homes and the unemployment rate to change in which of the following ways? INTEREST RATES     NEW HOMES     UNEMPLOYMENT RATE\",\"subject\":\"high_school_macroeconomics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}