{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"87f140d9-b3d1-51a8-92c2-2a896444d4c5","task_key":"default--test--6871","task_revision_id":"1","upstream_id":"6871","short_description":"Suppose we are told that an industry is composed of a small number of firms. Can…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['An oligopoly is determined solely by the size and number of firms, without considering market dynamics or inter-firm interactions.', 'An oligopoly is indicated by the presence of only government-owned firms in a market.', 'An oligopoly exists when each firm in an industry must contemplate the possible reactions of its rivals in deciding its own behavior.', 'An oligopoly exists when there are few sellers.', 'An oligopoly refers to an industry dominated by a single firm.', 'An oligopoly is present when firms are price takers and have no control over the market price of their goods.', 'An oligopoly is characterized by many small firms that each hold a negligible fraction of the market share.', 'An oligopoly is defined by having a single firm with significant market power, while the rest have very little influence.', 'An oligopoly exists when there are many sellers in a market, each with a differentiated product.', 'An oligopoly is defined by the number of firms in an industry.']\",\"question\":\"Suppose we are told that an industry is composed of a small number of firms. Can we immediately call this industry oligopolistic? Explain.\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}