{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d68861b6-1c8b-5482-bbb9-dfbb3d8bb40d","task_key":"default--test--7613","task_revision_id":"1","upstream_id":"7613","short_description":"What are the three major controls which the Federal Reserve System uses to…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Influence the prime rate, change the minimum wage, regulate the housing market', 'Adjust the savings account interest rates, regulate the production of goods, set the price of gold', 'control the fiscal policy, regulate the tax rate, adjust the budget deficit', 'Administer the rate of economic growth, control foreign aid distribution, regulate the cost of living', 'Set the federal funds rate, adjust social security payouts, manage import/export tariffs', 'adjust the GDP, control the unemployment rate, regulate the exchange rate', 'raise or lower the required reserve ratio, buy or sell bonds in the open market, raise or lower the discount rate', 'raise or lower the interest rate, buy or sell stocks, adjust the inflation rate', 'Manipulate the supply of currency, oversee stock market regulations, dictate corporate interest rates', 'Modify the national debt ceiling, alter consumer spending habits, control corporate tax rates']\",\"question\":\"What are the three major controls which the Federal Reserve System uses to manage money?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}