{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b5f1ac98-7492-5d11-83a0-79505dc4ccac","task_key":"default--test--7333","task_revision_id":"1","upstream_id":"7333","short_description":"Government intervention in the economy not only effects the level of economic…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['The Supply-side Economists', 'The Classical Economists', 'The Neoclassical Economists', 'The Mercantilists', 'The Chicago School of Economics', 'The Institutional Economists', 'The Keynesians', 'The Austrian School of Economics', 'The Monetarists']\",\"question\":\"Government intervention in the economy not only effects the level of economic activity, but it can also result in the redistribution of resources (from rich to poor people, for example ). What school of economists hastraditionally supported government intervention for both of these reasons ?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}