{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a7ab9efc-6852-5a9b-b063-45198ad705d7","task_key":"default--test--7431","task_revision_id":"1","upstream_id":"7431","short_description":"Which of the following would not be an example of contractionary fiscal policy?","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Increasing government subsidies to failing industries', 'Implementing a new, expensive military initiative', 'Implementing tax rebates for middle-income households', 'Increasing the minimum wage', 'Increasing money spent to pay for government projects', 'Increasing income taxes', 'Canceling the annual cost of living adjustments to the salaries of government employees', 'Decreasing money spent on social programs', 'Decreasing corporate tax rates', 'Lowering interest rates on government bonds']\",\"question\":\"Which of the following would not be an example of contractionary fiscal policy?\",\"src\":\"ori_mmlu-high_school_macroeconomics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}