{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2b874bdd-21bf-56f4-aff7-2ec21d9d5d30","task_key":"default--test--7330","task_revision_id":"1","upstream_id":"7330","short_description":"Define pure competition.","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Pure competition is when there are few buyers and sellers.', 'Pure competition occurs in markets where barriers to entry are high, preventing new firms from entering.', 'Pure competition is a market structure where a single buyer dictates the terms to multiple sellers.', 'Pure competition is when a single firm dominates the market.', 'Pure competition happens when firms can charge different prices without losing customers.', 'Pure competition involves only a handful of firms, each with significant control over the market price.', 'Pure competition exists when all firms in the market are price setters and can influence the market price.', 'Pure competition is characterized by product differentiation, where each firm offers a unique product to the market.', 'Pure competition is when there are numerous buyers and only one seller, who sets the price for a unique product.', 'Pure competition occurs in a market with numerous buyers and sellers exchanging a homogenous product, and with free entry into the market.']\",\"question\":\"Define pure competition.\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}