{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"dbc8fb18-60cc-5703-86e8-1c23e184301a","task_key":"default--test--6960","task_revision_id":"1","upstream_id":"6960","short_description":"If the economy were experiencing a recessionary gap choose the option below that…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Increase spending.    Decrease    Increase', 'Increase taxes.    Decrease    Increase', 'No change in taxes.    No change    No change', 'Decrease taxes. \\\\xa0\\\\xa0\\\\xa0 Increase \\\\xa0\\\\xa0\\\\xa0 Decrease', 'Decrease taxes. \\\\xa0\\\\xa0\\\\xa0 Increase \\\\xa0\\\\xa0\\\\xa0 Increase', 'Decrease spending. \\\\xa0\\\\xa0\\\\xa0 Decrease \\\\xa0\\\\xa0\\\\xa0 Increase', 'Increase taxes.    Increase    Increase', 'Increase taxes. \\\\xa0\\\\xa0\\\\xa0 Increase \\\\xa0\\\\xa0\\\\xa0 Decrease', 'Decrease spending.    Increase    Decrease']\",\"question\":\"If the economy were experiencing a recessionary gap choose the option below that would be an appropriate fiscal policy to eliminate the gap and the predicted impact of the policy on real GDP and unemployment. FISCAL POLICY     REAL GDP     UNEMPLOYMENT\",\"src\":\"ori_mmlu-high_school_macroeconomics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}