{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f87e58b6-dc87-5e03-8e18-893227887f8c","task_key":"default--test--6875","task_revision_id":"1","upstream_id":"6875","short_description":"What is a deflationary gap?","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['A situation where total demand is too small to absorb the total supply that an economy can produce at full employment level.', \\\"A gap that occurs when the government's budget deficit is too large\\\", 'The excess of actual unemployment over the natural rate of unemployment', 'An economic condition characterized by a sudden increase in asset prices', 'The difference between total income and total expenditure', 'A gap in the economy due to inflation', 'A temporary shortfall in consumer spending', 'The disparity between the nominal and real interest rates', \\\"A state where the money supply grows faster than the economy's productive capacity\\\", 'A scenario where total demand exceeds the total supply']\",\"question\":\"What is a deflationary gap?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}