{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b80b2339-afef-57b4-a90f-84fc0c767871","task_key":"default--test--7634","task_revision_id":"1","upstream_id":"7634","short_description":"Suppose the reserve ratio is 10 percent and the Fed buys $1 million in Treasury…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Money supply increases by $1 million, lowering the interest rate and increasing AD.', 'Money supply decreases by $10 million raising the interest rate and decreasing AD.', 'Money supply increases by $10 million lowering the interest rate and increasing AD.', 'Money supply remains constant, the interest rate falls and AD increases.', 'Money supply remains constant the interest rate does not fall and AD does not increase.', 'Money supply increases by $20 million, lowering the interest rate and increasing AD.', 'Money supply increases by $10 million, the interest rate falls and AD does not increase.', 'Money supply increases by $10 million the interest rate does not fall and AD does not increase.', 'Money supply decreases by $1 million, raising the interest rate and decreasing AD.', 'Money supply decreases by $20 million, raising the interest rate and decreasing AD.']\",\"question\":\"Suppose the reserve ratio is 10 percent and the Fed buys $1 million in Treasury securities from commercial banks. If money demand is perfectly elastic which of the following is likely to occur?\",\"src\":\"ori_mmlu-high_school_macroeconomics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}