{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5dfc3276-59ab-5f0f-a5e8-b543e45cc89e","task_key":"default--test--7546","task_revision_id":"1","upstream_id":"7546","short_description":"Define the Quantity Theory of Money.","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Price level variations are directly dependent upon changes in the quantity of money', 'The velocity of money is the only factor that affects the price level', 'The quantity of money in circulation has no impact on the economy or price levels', 'Changes in the quantity of money lead to proportional changes in the output level, not the price level', 'The quantity of money is inversely related to the velocity of money and has no direct relationship with the price level', 'The price level is determined by the production of goods and services, while the quantity of money remains constant', 'Price level variations are indirectly dependent upon changes in the quantity of money', 'The quantity of money is determined by the demand for goods and services, not by the price level', 'Price level is independent of the quantity of money', 'Quantity of money variations are directly dependent upon changes in the price level']\",\"question\":\"Define the Quantity Theory of Money.\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}