{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a483d3dc-e98a-5b2a-9f6c-d15d05a68020","task_key":"default--test--7012","task_revision_id":"1","upstream_id":"7012","short_description":"John Maynard Keynes actively supported direct government intervention in the…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Businesses were waiting for further reduction in interest rates', 'Low demand during the Depression made investments unprofitable, regardless of low interest rates.', 'The government had imposed too many regulations, which discouraged investment', 'Businesses lacked confidence in the economy', 'Interest rates were not truly low; there was a misperception about the monetary policy', 'There was a surplus of goods already, and no need for further production', 'Businesses were facing internal management issues', 'Businesses were primarily investing in foreign markets instead of the domestic economy', 'Businesses were unable to secure loans due to strict banking policies', 'High inflation rates were diminishing the real value of potential returns on investments']\",\"question\":\"John Maynard Keynes actively supported direct government intervention in the economy. In particular, he advocated deficit spending as a means to end the Great Depression because he thought business was not investing enough, even with low interest rates to maintain national income and employment at their pre-Depression levels. Why did busi-ness , in the view of Keynes, fail to invest in response to the low interest rates?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}