{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"023876a3-80cc-5a4a-b4cc-a9fe302f30d4","task_key":"all--test--023876a3-80cc-5a4a-b4cc-a9fe302f30d4","task_revision_id":"1","upstream_id":"","short_description":"Using the model of AD and AS what happens in the short run to real GDP the price…","config":"all","split":"test","body":"{\"choices\":\"['Increases \\\\xa0\\\\xa0\\\\xa0 Decreases \\\\xa0\\\\xa0\\\\xa0 Decreases', 'Decreases \\\\xa0\\\\xa0\\\\xa0 Increases \\\\xa0\\\\xa0\\\\xa0 Increases', 'Increases \\\\xa0\\\\xa0\\\\xa0 Increases \\\\xa0\\\\xa0\\\\xa0 Decreases', 'Decreases \\\\xa0\\\\xa0\\\\xa0 Decreases \\\\xa0\\\\xa0\\\\xa0 Decreases']\",\"question\":\"Using the model of AD and AS what happens in the short run to real GDP the price level and unemployment with more consumption spending (C)? REAL GDP     PRICE LEVEL     UNEMPLOYMENT\",\"subject\":\"high_school_macroeconomics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}