{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0a797fcc-ca45-5d8a-a22a-57eeb6eeb45d","task_key":"default--test--7604","task_revision_id":"1","upstream_id":"7604","short_description":"Neoclassical economists developed a production function in which all the factors…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Assumes that ownership of resources means the owner is entitled to all the benefits', 'It underestimates the value of labor', 'It overlooks the historical and social factors that affect the distribution of resources', 'It assumes perfect competition and complete information, which are rarely present in real markets', 'It ignores the potential for market power to influence the distribution of income', 'It assumes that the market always operates efficiently without any externalities', 'It overvalues the contribution of capital', 'It contradicts the socialist view', 'It does not take into account the role of government intervention in the economy', 'It implies that income derived from inheritance or monopolies is also morally justified']\",\"question\":\"Neoclassical economists developed a production function in which all the factors of production (land, capital, labor) received the value of their marginal product; that is, the interest paid to capital equals the contribution capital makes to the product, wages paid to labor equals the value of the marginal product of labor, etc. Some economists suggested that this result showed that the distribution of free, competitive capitalism is morally right and just. Whatis wrong with this suggestion?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}