{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6c4bdb60-e0f8-5bbe-9ec6-2f8f78ac8dcb","task_key":"default--test--6944","task_revision_id":"1","upstream_id":"6944","short_description":"The Federal Reserve's most important control instrument is open-market…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['The bank will lose an equivalent amount of reserve balances with the Federal Reserve', \\\"The bank's reserve balances will become negative as a result of the bond sale\\\", \\\"The bank's reserve balances increase due to interest payments on bonds\\\", 'The bank will lose reserve balances only if the bonds are sold to the public, not to the Federal Reserve', \\\"The bank's reserve requirement ratio will decrease\\\", 'The bank will gain more reserve balances', \\\"The bank's reserve balances will decrease by half the amount of the bonds sold\\\", \\\"The bank's reserve balances will double\\\", \\\"The bank's lending capacity will increase without any change in reserve balances\\\", \\\"The bank's reserve balances remain unchanged\\\"]\",\"question\":\"The Federal Reserve's most important control instrument is open-market operations. How is it that selling government bonds can reduce bank reserves?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}