{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0230a611-80ed-5ca4-bd0b-73fbdfb54f0a","task_key":"default--test--6889","task_revision_id":"1","upstream_id":"6889","short_description":"Expansionary monetary policy is designed to","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['increase the interest rate decrease private investment increase aggregate demand and increase domestic output.', 'decrease the interest rate, decrease private investment, decrease aggregate demand and increase domestic output.', 'increase the interest rate, decrease private investment, increase aggregate demand and decrease domestic output.', 'decrease the interest rate, increase private investment, decrease aggregate demand and decrease domestic output.', 'increase the interest rate, increase private investment, decrease aggregate demand and decrease domestic output.', 'decrease the interest rate increase private investment increase aggregate demand and increase the unemployment rate.', 'decrease the interest rate, decrease private investment, increase aggregate demand and decrease domestic output.', 'decrease the interest rate increase private investment increase aggregate demand and increase domestic output.', 'increase the interest rate increase private investment increase aggregate demand and increase domestic output.', 'increase the interest rate, decrease private investment, decrease aggregate demand and increase domestic output.']\",\"question\":\"Expansionary monetary policy is designed to\",\"src\":\"ori_mmlu-high_school_macroeconomics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}