{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b197ff3c-9887-51bf-b8c5-907e4186a42d","task_key":"all--test--b197ff3c-9887-51bf-b8c5-907e4186a42d","task_revision_id":"1","upstream_id":"","short_description":"If the short-run aggregate supply curve is horizontal it is because","config":"all","split":"test","body":"{\"choices\":\"['there exist many unemployed resources so that output can be increased without increasing wages and prices.', 'any increase in output requires a corresponding increase in wages and prices.', 'increases in output cause prices to increase but wages adjust much less quickly.', 'falling interest rates increase the demand for goods and services putting upward pressure on prices.']\",\"question\":\"If the short-run aggregate supply curve is horizontal it is because\",\"subject\":\"high_school_macroeconomics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}