{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"54790485-e2d6-558e-a33a-080192fd0ea7","task_key":"default--test--7391","task_revision_id":"1","upstream_id":"7391","short_description":"What is fiscal policy?","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Fiscal policy is the policy of the government with regard to the level of government spending and the tax structure.', 'Fiscal policy involves the regulation of private sector investment decisions', 'Fiscal policy is the set of rules governing the eligibility for welfare benefits', \\\"Fiscal policy is the government's strategy for managing the balance of trade\\\", 'Fiscal policy involves the management of interest rates and total supply of money in circulation', 'Fiscal policy is the decision-making process regarding tariffs and trade barriers', \\\"Fiscal policy is the government's strategy for managing inflation\\\", 'Fiscal policy is the process of a government issuing currency as a method of controlling the economy', 'Fiscal policy is the regulation of the money supply by the central bank', \\\"Fiscal policy determines the fixed exchange rates of a country's currency\\\"]\",\"question\":\"What is fiscal policy?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}