{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"907cc013-e5dd-55ef-b88f-806c862da209","task_key":"all--test--907cc013-e5dd-55ef-b88f-806c862da209","task_revision_id":"1","upstream_id":"","short_description":"Which statement best describes commercial liberalism?","config":"all","split":"test","body":"{\"choices\":\"['Commercial liberalism is the newest and most important faction of liberalism; it advocates socialist economic principles in order to address inequalities in the distribution of wealth that threaten societal and regime security.', 'Commercial liberalism is based on the idea that free-trade directly undermines the power of the state, and argues that the market should be regulated where possible by state actors. One flaw of commercial liberalism is that it reduces cooperation and can thus increase conflict between states.', 'Commercial liberalism is probably the oldest faction of liberalism; advocating free trade as the free movement of goods and capital, it purports that the most rapid and efficient production of wealth occurs when governments do not restrict the economic activity of private actors and the free market.', 'Commercial liberalism advocates the restraint of private enterprise and non-governmental activity in the economic sphere, arguing that interference will hinder economic prosperity.']\",\"question\":\"Which statement best describes commercial liberalism?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}