{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5a328f5b-6de0-58cf-9281-6afe5bd7ff43","task_key":"default--test--7085","task_revision_id":"1","upstream_id":"7085","short_description":"Suppose the balance sheet of an American bank looks, in its simplifiedform as…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['$5,000', '$3,800', '$120', '$2,880', '$408', '$600', '$3,192', '$2,300', '$1,760', '$2,100']\",\"question\":\"Suppose the balance sheet of an American bank looks, in its simplifiedform as follows (in 1000 dollars): Assets Liabilities and Capital cash $2,000 Demand deposits $12,000 Time & savings deposits 1,200 Balances in British bank 1,000 Deposits of states 600 U.S. Secur-ities 1,500 Common stock 200 Obligations 3,000 Surplus 1,000 Loans 9,000 Undivided profits 1,500 $ 16,500 $ 16,500 An Americanimporterwho is a depositor at this bank, buys $700 worth of British pounds to pay for his imports from Great Britain. British exporter deposits $2000 worth of British poundsin the bank in exchange for dollars. The State of New York sells an obligation of $1,000 to the bank and withdraws$700 in the form of cash. How is the balance statement of this bank changed? How muchare the excess reserves in the original and in the new situationif the legal reserve requirement is 24%?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}