{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"67e0aab4-c249-5715-b948-fd5679b8011f","task_key":"all--test--67e0aab4-c249-5715-b948-fd5679b8011f","task_revision_id":"1","upstream_id":"","short_description":"Suppose the real interest rate in a country rises. What can be expected to…","config":"all","split":"test","body":"{\"choices\":\"['Decreases \\\\xa0\\\\xa0\\\\xa0\\\\xa0  \\\\xa0\\\\xa0\\\\xa0\\\\xa0 Appreciate \\\\xa0\\\\xa0\\\\xa0\\\\xa0 Decreases ', 'Decreases \\\\xa0\\\\xa0\\\\xa0\\\\xa0  \\\\xa0\\\\xa0\\\\xa0\\\\xa0 Depreciate \\\\xa0\\\\xa0\\\\xa0\\\\xa0 Decreases', 'Decreases \\\\xa0\\\\xa0\\\\xa0\\\\xa0  \\\\xa0\\\\xa0\\\\xa0\\\\xa0 Depreciate \\\\xa0\\\\xa0\\\\xa0\\\\xa0 Increases', 'Increases \\\\xa0\\\\xa0\\\\xa0\\\\xa0  \\\\xa0\\\\xa0\\\\xa0\\\\xa0 Appreciate \\\\xa0\\\\xa0\\\\xa0\\\\xa0 Increases']\",\"question\":\"Suppose the real interest rate in a country rises. What can be expected to happen to the demand for this nation's currency and therefore the value of its currency and net exports? Demand for currency      Value of currency      Net exports\",\"subject\":\"high_school_macroeconomics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}