{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a775c055-73e9-56eb-8e92-b0a3a2989279","task_key":"default--test--7275","task_revision_id":"1","upstream_id":"7275","short_description":"In oligopoly we have a \"few\" firms and hence we do not reap allthe benefits of…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Higher barriers to entry for new competitors', 'Producers have complete control over the market prices', 'Decreased consumer choice due to monopolistic control', 'Decreased product variety and innovation', 'Wasted resources, producer losses, and higher consumer prices', 'Increased competition', 'Efficient production', 'Lower consumer prices', 'Perfect competition with maximum consumer benefits', 'Market saturation leading to reduced market entry']\",\"question\":\"In oligopoly we have a \\\"few\\\" firms and hence we do not reap allthe benefits of perfect competition. The other side of the coinis an industry in which there are an excessive number ofsellers. Explain the consequences of this situation.\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}