{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5a2d0bff-5cc1-56e1-b38e-813d90757d2d","task_key":"default--test--7539","task_revision_id":"1","upstream_id":"7539","short_description":"How can the debt management of the U.S. Treasury contrib-uteto economic…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['The Treasury must not issue any debt during a recession or inflation.', 'The Treasury should only issue debt during periods of economic surplus to prepare for future recessions.', 'The Treasury must issue short-term debt during a recession and long-term debt during high inflation.', 'The Treasury must issue more currency rather than debt to manage economic cycles.', 'The Treasury must issue equal amounts of short-term and long-term debts at all times.', 'The Treasury must issue long-term debt during a recession and short-term debt during high inflation.', 'The Treasury must issue inflation-indexed bonds primarily during periods of stable economic growth.', 'The Treasury must issue debt exclusively to foreign investors during economic downturns.', 'The Treasury must continuously decrease the national debt to stabilize the economy.', 'The Treasury should prioritize foreign debt issuance to manage domestic economic stability.']\",\"question\":\"How can the debt management of the U.S. Treasury contrib-uteto economic stabilization?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}