{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"10dd2b97-8bcf-5383-baf1-293b3c5bb48d","task_key":"default--test--7575","task_revision_id":"1","upstream_id":"7575","short_description":"Which of the following is a characteristic of monopolistic competition?","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Very few competitors.', 'One firm sets the market price.', 'Identical products offered by each firm.', 'Excess capacity.', 'Significant barriers to entry.', 'Only one seller in the market.', 'Firms are price takers.', 'Homogeneous market demand.', 'Pricing at minimum ATC in long run.', 'Economically efficient in the long run.']\",\"question\":\"Which of the following is a characteristic of monopolistic competition?\",\"src\":\"ori_mmlu-high_school_microeconomics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}