{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bbc39e0e-9d29-5ee7-964b-078da96e5120","task_key":"default--test--7603","task_revision_id":"1","upstream_id":"7603","short_description":"What are the principal and selective instruments of control of which the Federal…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Open-market operations, setting the national budget, and changing the federal funds rate', 'Open-market operations, changes in the discount rate, and changes in the reserve requirements of the member banks', 'Adjusting the federal funds rate, implementing quantitative easing, and altering the tax rates', 'Interest rate adjustments, liquidity ratio changes, and open-market operations', 'Modifying the capital gains tax, reserve requirements, and federal funds rate adjustments', 'Changes in the discount rate, direct lending to banks, and setting the exchange rate', 'Discounting at Federal Reserve banks, margin requirements on stock purchases, and ceilings on bank deposit interest rates', 'Issuing new currency, adjusting the inflation target, and open-market operations', 'Changes in the prime rate, reserve requirements, and bond purchases', 'Modifying the income tax rate, reserve requirements, and changes in the discount rate']\",\"question\":\"What are the principal and selective instruments of control of which the Federal Reserve System makes use?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}