{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"32d2308c-d953-5bd3-9094-8958ab964dd5","task_key":"default--test--6968","task_revision_id":"1","upstream_id":"6968","short_description":"Which of the following statements would \"supply-side\" economists disagree with?","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Tax changes cause shifts in aggregate supply that work against shifts in aggregate demand thus reducing the effect of the tax change on real GDP.', 'A tax increase is likely to decrease aggregate supply by decreasing after-tax wages and thus providing disincentives to work.', 'A tax cut is likely to increase aggregate supply by boosting saving investment and thus capital accumulation.', 'A tax cut is likely to increase aggregate supply by providing greater rewards for risk taking.', 'A tax cut is likely to decrease aggregate supply by creating a budget deficit.']\",\"question\":\"Which of the following statements would \\\"supply-side\\\" economists disagree with?\",\"src\":\"ori_mmlu-high_school_macroeconomics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}