{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1064ba66-e7be-5bcb-b2eb-76be7e579814","task_key":"default--test--5455","task_revision_id":"1","upstream_id":"5455","short_description":"If the government places a price ceiling on leather garments that is below the…","config":"default","split":"test","body":"{\"category\":\"other\",\"options\":\"['The price of leather garments will remain the same.', 'The demand curve for leather garments will shift rightward.', 'There will be a surplus.', 'The supply curve for leather garments will shift leftward.', 'There will be no effect on the supply or demand for leather garments.', 'The supply curve for leather garments will shift rightward.', 'The demand curve for leather garments will shift leftward.', 'There will be an increase in the production of leather garments.', 'The price of leather garments will rise.', 'There will be a shortage.']\",\"question\":\"If the government places a price ceiling on leather garments that is below the equilibrium price, which of the following will occur in the market for leather garments?\",\"src\":\"ori_mmlu-miscellaneous\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}