{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"eb5981c2-2931-58da-a6c1-52b2e3f1f8b2","task_key":"default--test--7017","task_revision_id":"1","upstream_id":"7017","short_description":"After the initial rejection of monetary policy by Keynesians, why did they…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['The rise of monetarism and its influence on Keynesian economists', 'Unavailability of empirical research on monetary policy', 'Stagnation in technological advancements affecting economic growth', 'The discovery of a new economic theory that replaced Keynesian economics', \\\"Recognition of fiscal policy's ineffectiveness in times of high inflation\\\", 'Lack of changes in the money supply', 'Increased government regulation in financial markets', 'Failure of predictions based on fiscal policy and empirical research on effects of changes in money supply', 'Success of fiscal policy in controlling inflation', 'The impact of international trade on domestic monetary policy']\",\"question\":\"After the initial rejection of monetary policy by Keynesians, why did they change their minds and include both monetary and fiscal policy as policy options?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}