{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d1b140d0-5b01-54b5-9d7a-c79f4ebd3870","task_key":"default--test--7023","task_revision_id":"1","upstream_id":"7023","short_description":"Under a pure capitalist system, would the government play a majorrole in the…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Government intervenes only during economic crises to stabilize the market', 'Government plays a minor role by enforcing contracts and property rights', 'No government intervention in the economy', 'Government provides public goods and services but does not control private enterprise', 'Limited government intervention primarily in defense and public safety', 'Government sets minimum wage and workplace safety standards but is otherwise not involved', 'Government controls all aspects of the economy', 'Government regulates certain industries but does not control the economy', 'Government sets the prices for all goods and services', 'Government owns all businesses and properties']\",\"question\":\"Under a pure capitalist system, would the government play a majorrole in the economy?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}