{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"756e69ae-955f-59d0-88df-1d9e9c6e90a0","task_key":"all--test--756e69ae-955f-59d0-88df-1d9e9c6e90a0","task_revision_id":"1","upstream_id":"","short_description":"The economy is currently operating at full employment. Assuming flexible wages…","config":"all","split":"test","body":"{\"choices\":\"['Falls \\\\xa0\\\\xa0\\\\xa0 Falls \\\\xa0\\\\xa0\\\\xa0 No change \\\\xa0\\\\xa0\\\\xa0 Falls', 'Falls \\\\xa0\\\\xa0\\\\xa0 Falls \\\\xa0\\\\xa0\\\\xa0 Falls \\\\xa0\\\\xa0\\\\xa0 Falls', 'No change \\\\xa0\\\\xa0\\\\xa0 Falls \\\\xa0\\\\xa0\\\\xa0 No change \\\\xa0\\\\xa0\\\\xa0 No change', 'Falls \\\\xa0\\\\xa0\\\\xa0 Falls \\\\xa0\\\\xa0\\\\xa0 No change \\\\xa0\\\\xa0\\\\xa0 No change']\",\"question\":\"The economy is currently operating at full employment. Assuming flexible wages and prices how would a decline in aggregate demand affect GDP and the price level in the short run and GDP and the price level in the long run? SHORT-RUN GDP     SHORT-RUN PRICE LEVEL     LONG-RUN GDP     LONG-RUN PRICE LEVEL\",\"subject\":\"high_school_macroeconomics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}