{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"330fbfea-9aa9-5f1c-af8c-fa8792eb3304","task_key":"all--test--330fbfea-9aa9-5f1c-af8c-fa8792eb3304","task_revision_id":"1","upstream_id":"","short_description":"Which of the following is characteristic of a centrally planned economic system?","config":"all","split":"test","body":"{\"choices\":\"['Resources are allocated based on relative prices.', 'The circular flow of goods and services minimizes the role of the federal government.', 'Private ownership of resources is fundamental to economic growth.', 'Government planners decide how best to produce goods and services.']\",\"question\":\"Which of the following is characteristic of a centrally planned economic system?\",\"subject\":\"high_school_macroeconomics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}