{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8d1e3409-cd90-582e-bd50-dc4bc091b5f8","task_key":"default--test--7326","task_revision_id":"1","upstream_id":"7326","short_description":"How does a progressive income tax help to stabilize the economy?","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['It encourages higher spending in the private sector.', 'It caps personal wealth to a fixed amount.', 'It directly controls inflation.', 'It increases government revenue.', 'It adds an element of built-in stability to an economy.', 'It reduces income inequality.', 'It incentivizes higher investment in education.', 'It reduces the cost of living for all citizens.', 'It decreases the overall tax burden.', 'It promotes economic growth.']\",\"question\":\"How does a progressive income tax help to stabilize the economy?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}