{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3ef38e6c-399e-5281-97f7-b1bdc1d3388b","task_key":"default--test--7034","task_revision_id":"1","upstream_id":"7034","short_description":"Suppose that elected officials and the central bank agree to combine fiscal and…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Decrease taxes \\\\xa0\\\\xa0\\\\xa0 Sell government securities', 'Decrease taxes \\\\xa0\\\\xa0\\\\xa0 Increase the reserve ratio', 'Increase spending \\\\xa0\\\\xa0\\\\xa0 Buy government securities', 'Increase taxes \\\\xa0\\\\xa0\\\\xa0 Increase the discount ratio', 'Decrease spending \\\\xa0\\\\xa0\\\\xa0 Decrease the reserve ratio', 'Decrease spending \\\\xa0\\\\xa0\\\\xa0 Buy government securities', 'Decrease taxes \\\\xa0\\\\xa0\\\\xa0 Decrease the discount ratio', 'Increase spending \\\\xa0\\\\xa0\\\\xa0 Increase the discount ratio', 'Increase spending \\\\xa0\\\\xa0\\\\xa0 Sell government securities', 'Increase taxes \\\\xa0\\\\xa0\\\\xa0 Decrease the reserve ratio']\",\"question\":\"Suppose that elected officials and the central bank agree to combine fiscal and monetary policies to lessen the threat of inflation. Which of the following combinations would likely accomplish this goal? FISCAL POLICY     MONETARY POLICY\",\"src\":\"ori_mmlu-high_school_macroeconomics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}