{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e5fe1402-2943-5670-83b0-e0f08d7da286","task_key":"default--test--7006","task_revision_id":"1","upstream_id":"7006","short_description":"Classical and neoclassical (marginalist) theorists have usually supported the…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Keynes supported a market economy with equal government and private enterprise control', 'Keynes was completely against government intervention', 'Keynes believed in a completely free private enterprise economy', 'Keynes promoted only minor tweaks to the market system, without significant government intervention', 'Keynes believed government intervention should only occur in times of war or crisis', 'Keynes was an advocate for a mixed economy, but with minimal roles for both the government and the private sector', 'Keynes argued for a purely government-run economy, with no market influences', 'Keynes sought to abolish private ownership in favor of a fully government-controlled economy', 'Keynes wanted to replace the market system', 'Keynes aimed to stabilize the market economy']\",\"question\":\"Classical and neoclassical (marginalist) theorists have usually supported the market system of allocation. Be-cause of this, they usually opposed government inter-vention in the economy . Keynes advocated government inter-vention. Does this mean he was against the market economy?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}