{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"10bc6ca1-ae3b-52a6-9466-59c8a2c473fd","task_key":"default--test--7119","task_revision_id":"1","upstream_id":"7119","short_description":"Which of the following statements about a price ceiling is accurate?","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['A price ceiling will have no effect on the quantity of the good supplied.', 'A price ceiling will cause a shift in the supply curve for the good.', 'A price ceiling always results in a surplus of the good.', 'A price ceiling will increase the total revenue of buyers.', 'An effective price ceiling must be at a price above the equilibrium price.', 'A price ceiling will cause a shift in the demand curve for the good.', 'A price ceiling always leads to a decrease in the quality of the good.', 'A price ceiling will increase the quantity of the good supplied.', 'A price ceiling will decrease the total revenue of sellers.', 'An effective price ceiling must be at a price below the equilibrium price.']\",\"question\":\"Which of the following statements about a price ceiling is accurate?\",\"src\":\"ori_mmlu-high_school_microeconomics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}