{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5e7a2fbd-053c-590a-8054-22a604f326e9","task_key":"default--test--6858","task_revision_id":"1","upstream_id":"6858","short_description":"What is Fascism as an economic system?","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Fascism promotes a mixed economy where the state owns some means of production, but there is also significant private enterprise', 'Fascist economies are characterized by complete state ownership of all means of production, similar to a communist system', 'Fascist system retains the institutional forms of a capitalist economy while subjecting these institutions to extensive control and regulation by the government.', 'Fascism is a system where the means of production are owned and managed by worker collectives', 'Fascism supports a laissez-faire approach with minimal government intervention in the economy', 'Fascism is a purely capitalist system', 'Fascism is an anarchic system without any government control', 'Fascist economic systems are identified by their promotion of free trade and open markets internationally', 'Fascism is based on the principle of universal basic income and the redistribution of wealth', 'Fascism is a form of socialist economy']\",\"question\":\"What is Fascism as an economic system?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}