{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c47bd03c-f4b3-5c01-b694-6200daff5a17","task_key":"default--test--7631","task_revision_id":"1","upstream_id":"7631","short_description":"How does an increasing national debt impact the market for U.S. dollars and the…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['Increased supply \\\\xa0\\\\xa0\\\\xa0 Depreciating', 'Decreased supply \\\\xa0\\\\xa0\\\\xa0 Appreciating', 'No change in supply \\\\xa0\\\\xa0\\\\xa0 Appreciating', 'Increased demand \\\\xa0\\\\xa0\\\\xa0 Depreciating', 'Decreased demand \\\\xa0\\\\xa0\\\\xa0 Appreciating', 'Increased demand \\\\xa0\\\\xa0\\\\xa0 Appreciating', 'Decreased supply \\\\xa0\\\\xa0\\\\xa0 Depreciating', 'Increased supply \\\\xa0\\\\xa0\\\\xa0 Appreciating', 'No change in demand \\\\xa0\\\\xa0\\\\xa0 Depreciating']\",\"question\":\"How does an increasing national debt impact the market for U.S. dollars and the value of the dollar with respect to other currencies? MARKET FOR THE DOLLAR     VALUE OF THE DOLLAR\",\"src\":\"ori_mmlu-high_school_macroeconomics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}