{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"46b0176c-4f5b-50e0-9086-d903f3513b41","task_key":"default--test--7579","task_revision_id":"1","upstream_id":"7579","short_description":"If the perfectly competitive price is currently above minimum ATC, we can expect…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Market equilibrium quantity falls as firms enter the industry.', 'Price falls as firms enter the industry.', 'Price rises as firms exit the industry.', 'Nothing. The industry is currently in long-run equilibrium.', 'The industry becomes a monopoly.', 'Market equilibrium quantity rises as firms exit the industry.', 'Price rises as firms enter the industry.', 'Price falls as firms exit the industry.', 'Price remains stable as industry conditions do not change.']\",\"question\":\"If the perfectly competitive price is currently above minimum ATC, we can expect which of the following events in the long run?\",\"src\":\"ori_mmlu-high_school_microeconomics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}