{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"852a8fae-1740-5b65-9833-5a5820cfe142","task_key":"all--test--852a8fae-1740-5b65-9833-5a5820cfe142","task_revision_id":"1","upstream_id":"","short_description":"Which of the following statements is true of production possibility curves and…","config":"all","split":"test","body":"{\"choices\":\"['Nations specialize and trade based on absolute advantage in production.', 'Free trade allows each nation to consume beyond the production possibility curve.', 'The flow of goods and services is based on the principle of absolute advantage.', 'Nations can consume at points beyond the production possibility curve by protecting domestic industries from free trade.']\",\"question\":\"Which of the following statements is true of production possibility curves and trade between nations?\",\"subject\":\"high_school_macroeconomics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}