{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"94eb6d7d-5c10-505f-b788-cb7f05660886","task_key":"default--test--7386","task_revision_id":"1","upstream_id":"7386","short_description":"What is meant by \"fractional reserve\" banking?","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Fractional reserve banking is the practice where banks lend out a portion of their deposits while keeping a fraction in the form of gold reserves.', 'Fractional reserve banking permits banks to keep a varying reserve ratio depending on the size of the deposit.', 'Fractional reserve banking is when banks are required to keep 100% of their deposits in cash.', 'Fractional reserve banking means that banks keep all of their deposits in cash.', 'Fractional reserve banking refers to the practice of banks lending out all their deposits.', 'Fractional reserve banking is a system where banks are required to keep only a fraction of their deposits in liquid form and can invest the remainder in government bonds only.', 'Fractional reserve banking means that banks keep less than 100% of their deposits in cash, placing the rest in income-earning investments.', 'Fractional reserve banking allows banks to lend out exactly 50% of their deposits and requires them to hold the other 50% in reserve.', 'Fractional reserve banking mandates that banks hold a fixed reserve of 20% of their deposits and are free to use the rest without restrictions.', 'Fractional reserve banking is the system in which banks are allowed to issue loans equal to the amount of deposits they have, without maintaining any reserves.']\",\"question\":\"What is meant by \\\"fractional reserve\\\" banking?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}