{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a795e76f-f2f8-5b9e-921e-397b0c9dfc40","task_key":"all--test--a795e76f-f2f8-5b9e-921e-397b0c9dfc40","task_revision_id":"1","upstream_id":"","short_description":"If current real GDP is $5000 and full employment real GDP is at $4000 which of…","config":"all","split":"test","body":"{\"choices\":\"['A decrease in taxes and a lower discount rate', 'An increase in government spending and an increase in taxes', 'A decrease in taxes and selling bonds in an open market operation', 'An increase in government spending and an increase in the discount rate']\",\"question\":\"If current real GDP is $5000 and full employment real GDP is at $4000 which of the following combinations of policies is the most likely to have brought the economy to this point?\",\"subject\":\"high_school_macroeconomics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}