{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fc59fd6b-3fda-5dee-bc3b-00dc835c1f53","task_key":"default--test--6952","task_revision_id":"1","upstream_id":"6952","short_description":"What is a command Economy?","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['A Command Economy is one where resources are allocated based on a voting system among all citizens.', 'A Command Economy is one where resources are allocated based on market demand.', 'A Command Economy is one where the government only controls key industries, and the rest is market-driven.', 'A Command Economy is one where resources are allocated by a decentralized system of local governments with no central authority.', 'A Command Economy is one where resources are distributed evenly among all citizens.', 'A Command Economy is one in which resources are allocated according to the commands of a central planning authority.', 'A Command Economy is one where allocation of resources is determined by tradition and cultural practices.', 'A Command Economy is one where resources are allocated based on the wealth of individuals.', 'A Command Economy is one in which prices and production levels are determined by non-profit organizations.', 'A Command Economy is one where allocation of resources is determined by the competition among private companies.']\",\"question\":\"What is a command Economy?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}