{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0ed61cc7-5a21-5e48-8799-06753abc1fe9","task_key":"default--test--7202","task_revision_id":"1","upstream_id":"7202","short_description":"What is the main objective of modem central banking? Explain.","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Formulation of policies that influence the monetary base.', 'Controlling inflation', 'Directly controlling unemployment rates', 'Managing government spending and fiscal policy', 'Overseeing the stock market and financial investments', 'Regulating commercial banks', 'Ensuring economic stability', 'Setting fixed exchange rates for global currencies', 'Providing consumer loans and personal banking services', 'Determining tax rates for individual income']\",\"question\":\"What is the main objective of modem central banking? Explain.\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}