{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"92275cd3-b0e5-5cdd-b82a-7d7801de1dbd","task_key":"all--test--92275cd3-b0e5-5cdd-b82a-7d7801de1dbd","task_revision_id":"1","upstream_id":"","short_description":"In the design of a competitive market system, which of the following does NOT…","config":"all","split":"test","body":"{\"choices\":\"['Price signals that guide producers on what, when, how, and for whom to produce goods and services.', 'Active government ownership and direction of production.', 'Voluntary market exchange between buyers and sellers.', 'Distribution of income and goods on the basis of contribution or productivity.']\",\"question\":\"In the design of a competitive market system, which of the following does NOT describe how resources are allocated?\",\"subject\":\"high_school_microeconomics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}