{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0baa2423-61f9-5c28-8cd9-91f6b5109d38","task_key":"all--test--0baa2423-61f9-5c28-8cd9-91f6b5109d38","task_revision_id":"1","upstream_id":"","short_description":"Suppose that elected officials and the central bank agree to combine fiscal and…","config":"all","split":"test","body":"{\"choices\":\"['Decrease taxes \\\\xa0\\\\xa0\\\\xa0 Increase the reserve ratio', 'Decrease spending \\\\xa0\\\\xa0\\\\xa0 Buy government securities', 'Decrease taxes \\\\xa0\\\\xa0\\\\xa0 Sell government securities', 'Increase taxes \\\\xa0\\\\xa0\\\\xa0 Increase the discount ratio']\",\"question\":\"Suppose that elected officials and the central bank agree to combine fiscal and monetary policies to lessen the threat of inflation. Which of the following combinations would likely accomplish this goal? FISCAL POLICY     MONETARY POLICY\",\"subject\":\"high_school_macroeconomics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}