{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d45e29b9-c3dd-57f4-b108-ee729a44236b","task_key":"default--test--6857","task_revision_id":"1","upstream_id":"6857","short_description":"What is Market Socialism?","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['An economic system incorporating features of capitalistic markets and socialist planning, characterized by state ownership of land and capital, state-determined investment, market-set wages, and some income redistribution.', 'A system where the market dictates all aspects of the economy, including social welfare and public goods provision', 'An economic system characterized by complete state ownership of all industries, with prices and production centrally planned', 'A purely capitalistic system', 'A theoretical model where private individuals own resources and engage in voluntary exchanges, but profits are redistributed by the state', 'A mixed economic system with equal distribution of personal wealth regardless of individual contribution or market dynamics', 'An economic system where the government solely determines production, investment, and prices without any market influence', 'A system with no state intervention', 'A system where only the private sector determines investment', 'A form of socialism with worker-managed firms competing in free markets without any government intervention']\",\"question\":\"What is Market Socialism?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}