{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d066a75b-b8aa-5ec4-928e-70c234eab26d","task_key":"default--test--7243","task_revision_id":"1","upstream_id":"7243","short_description":"If the perfectly competitive price is currently below minimum average total…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Market equilibrium quantity will increase as firms exit the industry.', 'The price will fall to the breakeven point as firms enter the industry.', 'The industry will remain in a state of disequilibrium.', 'The price will rise to the breakeven point as firms exit the industry.', 'Nothing. The industry is currently in long-run equilibrium.', 'Market equilibrium quantity will decrease as firms enter the industry.', 'The price will stay the same as firms exit the industry.', 'The price will fall further as firms enter the industry.', \\\"The price will rise and each firm's output will increase as firms enter the industry.\\\", \\\"The price will rise and each firm's output will fall as firms exit the industry.\\\"]\",\"question\":\"If the perfectly competitive price is currently below minimum average total cost, we can expect which of the following events in the long run?\",\"src\":\"ori_mmlu-high_school_microeconomics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}