{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c28c9b29-c128-556a-9592-492e2e0459d5","task_key":"default--test--7564","task_revision_id":"1","upstream_id":"7564","short_description":"Suppose the real interest rate in a country rises. What can be expected to…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Increases \\\\xa0\\\\xa0\\\\xa0\\\\xa0  \\\\xa0\\\\xa0\\\\xa0\\\\xa0 Appreciate \\\\xa0\\\\xa0\\\\xa0\\\\xa0 Decreases', 'No Change \\\\xa0\\\\xa0\\\\xa0\\\\xa0  \\\\xa0\\\\xa0\\\\xa0\\\\xa0 Depreciate \\\\xa0\\\\xa0\\\\xa0\\\\xa0 Increases', 'Increases \\\\xa0\\\\xa0\\\\xa0\\\\xa0  \\\\xa0\\\\xa0\\\\xa0\\\\xa0 Depreciate \\\\xa0\\\\xa0\\\\xa0\\\\xa0 Increases', 'Increases \\\\xa0\\\\xa0\\\\xa0\\\\xa0  \\\\xa0\\\\xa0\\\\xa0\\\\xa0 Appreciate \\\\xa0\\\\xa0\\\\xa0\\\\xa0 Increases', 'Decreases \\\\xa0\\\\xa0\\\\xa0\\\\xa0  \\\\xa0\\\\xa0\\\\xa0\\\\xa0 Appreciate \\\\xa0\\\\xa0\\\\xa0\\\\xa0 Decreases ', 'Decreases \\\\xa0\\\\xa0\\\\xa0\\\\xa0  \\\\xa0\\\\xa0\\\\xa0\\\\xa0 Appreciate \\\\xa0\\\\xa0\\\\xa0\\\\xa0 Increases', 'Decreases \\\\xa0\\\\xa0\\\\xa0\\\\xa0  \\\\xa0\\\\xa0\\\\xa0\\\\xa0 Depreciate \\\\xa0\\\\xa0\\\\xa0\\\\xa0 Increases', 'No Change \\\\xa0\\\\xa0\\\\xa0\\\\xa0  \\\\xa0\\\\xa0\\\\xa0\\\\xa0 Appreciate \\\\xa0\\\\xa0\\\\xa0\\\\xa0 Decreases', 'Increases \\\\xa0\\\\xa0\\\\xa0\\\\xa0  \\\\xa0\\\\xa0\\\\xa0\\\\xa0 Depreciate \\\\xa0\\\\xa0\\\\xa0\\\\xa0 Decreases', 'Decreases \\\\xa0\\\\xa0\\\\xa0\\\\xa0  \\\\xa0\\\\xa0\\\\xa0\\\\xa0 Depreciate \\\\xa0\\\\xa0\\\\xa0\\\\xa0 Decreases']\",\"question\":\"Suppose the real interest rate in a country rises. What can be expected to happen to the demand for this nation's currency and therefore the value of its currency and net exports? Demand for currency      Value of currency      Net exports\",\"src\":\"ori_mmlu-high_school_macroeconomics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}