{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4c0d8654-44cc-5d31-bcf4-e26f46f10247","task_key":"default--test--7686","task_revision_id":"1","upstream_id":"7686","short_description":"Suppose the demand for a particular product falls while the supply…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['The equilibrium price is indeterminate while the equilibrium quantity will fall.', 'The equilibrium price will fall while the equilibrium quantity will rise.', 'The equilibrium price is indeterminate while the equilibrium quantity will remain unchanged.', 'The equilibrium price will rise while the equilibrium quantity is indeterminate.', 'The equilibrium price will rise while the equilibrium quantity will fall.', 'The equilibrium price is indeterminate while the equilibrium quantity will rise.', 'The equilibrium price and quantity will both rise.', 'The equilibrium price and quantity will both fall.', 'The equilibrium price and quantity will remain unchanged.', 'The equilibrium price will fall while the equilibrium quantity is indeterminate.']\",\"question\":\"Suppose the demand for a particular product falls while the supply simultaneously increases. What will happen to the equilibrium price and the equilibrium quantity?\",\"src\":\"ori_mmlu-high_school_macroeconomics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}