{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c8d295b9-c5c9-5b03-b93f-8a4a974fef85","task_key":"default--test--7193","task_revision_id":"1","upstream_id":"7193","short_description":"Which institutions and/or persons gain from anticipated inflation and why?","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Bankowners and the United States Treasury gain from anticipated inflation', 'Wage earners gain from anticipated inflation due to rising wages', 'Creditors gain from anticipated inflation', 'Foreign investors gain from anticipated inflation', 'The general public gains from anticipated inflation', 'Savers gain from anticipated inflation as the value of their savings increases', 'Importers gain from anticipated inflation by getting cheaper foreign goods', 'Exporters gain from anticipated inflation due to increased competitiveness abroad', 'Consumers gain from anticipated inflation through increased purchasing power']\",\"question\":\"Which institutions and/or persons gain from anticipated inflation and why?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}