{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0418979b-807a-5145-9d35-c80aa36674ab","task_key":"default--test--7398","task_revision_id":"1","upstream_id":"7398","short_description":"Contrast the way in which economic information is utilized anddisseminated in…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['In capitalism, information flows through social networks and informal channels, while in socialism, it is strictly regulated by the state.', 'In socialism, information is freely available to all, while in capitalism, it is a commodity bought and sold in the market.', 'In socialism, information is disseminated via market prices, while in capitalism, it is distributed through a network of state-owned enterprises.', \\\"In capitalism, information is collected centrally, while in socialism, it's disseminated via market prices.\\\", 'In both capitalism and socialism, information is disseminated via market prices.', 'In capitalism, information is disseminated via market prices, while in socialism, information is collected centrally due to the absence of market prices.', 'In capitalism, information is shared publicly by the government, while in socialism, it is kept secret and only used by the state planners.', 'In capitalism, information dissemination is not necessary due to the self-regulating market, while in socialism, information is disseminated through public forums.', 'In both systems, information is primarily disseminated through government planning agencies.', \\\"In capitalism, information is controlled by the government, while in socialism, it's controlled by entrepreneurs.\\\"]\",\"question\":\"Contrast the way in which economic information is utilized anddisseminated in capitalist and socialist economies, respectively.\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}