{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2710ec69-3b5b-5c70-b62d-1fec3f8222e5","task_key":"default--test--7263","task_revision_id":"1","upstream_id":"7263","short_description":"What is the economic effect of the increase in the number of financial…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Decreases the diversity of financial products available', 'Decreases the number of financial intermediaries', 'Reduces the overall liquidity in the financial system', 'Decreases the velocity of money', 'Leads to a decrease in consumer lending options', 'Increases the velocity of money', 'Has no effect on the velocity of money', 'Enhances the direct investment into the economy', 'Increases the cost of capital for businesses', 'Stabilizes the stock market volatility']\",\"question\":\"What is the economic effect of the increase in the number of financial intermediaries?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}