{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"daef7677-fc7e-5eba-bcc4-f45de0ff33ad","task_key":"default--test--7079","task_revision_id":"1","upstream_id":"7079","short_description":"With the emergence of corporate giants, John Kenneth Galbraith theorized a new…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Countervailing power is the economic control exercised by trade unions.', 'Countervailing power is the influence consumers have through boycotts and advocacy.', 'Countervailing power eliminates the need for government regulation.', 'Countervailing power describes the competitive advantage of large corporations.', 'Countervailing power is the self-regulation by corporations to prevent government intervention.', 'Countervailing power describes the restraints that are placed on giant corporations in the absence of competition.', 'Countervailing power refers to the international regulations imposed on multinational corporations.', 'Countervailing power is the authority of government to nationalize large corporations.', 'Countervailing power is the power held by small businesses.', 'Countervailing power represents the balancing effect of monopolies within a free market.']\",\"question\":\"With the emergence of corporate giants, John Kenneth Galbraith theorized a new version of price regulation. Describe his concept of 'countervailing power'.\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}