{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ee778932-2f80-5189-96be-e0f45ad239fe","task_key":"default--test--7628","task_revision_id":"1","upstream_id":"7628","short_description":"The crowding-out effect from government borrowing is best described as","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['the rightward shift in AD in response to the decreasing interest rates from contractionary fiscal policy.', 'the leftward shift in AD in response to the rising interest rates from expansionary fiscal policy.', 'the effect of the President increasing the money supply which decreases real interest rates and increases AD.', 'the effect on the economy of hearing the chairperson of the central bank say that he or she believes that the economy is in a recession.']\",\"question\":\"The crowding-out effect from government borrowing is best described as\",\"src\":\"ori_mmlu-high_school_macroeconomics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}