{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fe020860-6736-53f4-8fc1-3c854156d73b","task_key":"default--test--7592","task_revision_id":"1","upstream_id":"7592","short_description":"How is the federal payroll tax that supports the Social Security program a…","config":"default","split":"test","body":"{\"category\":\"economics\",\"options\":\"['The tax is regressive because only self-employed individuals are required to pay it.', 'The tax is regressive because all workers pay the same percentage of their income.', 'The tax is regressive because higher incomes are taxed at a higher rate.', 'The tax is regressive because it only applies to the first $10,000 of income.', 'The tax is regressive because it exempts all investment income.', 'The tax is regressive because it includes additional deductions for higher income earners.', 'The tax is regressive because there is a dollar limit on the amount of income, subject to the tax.', 'The tax is regressive because lower incomes are not taxed to provide relief to lower earners.', 'The tax is regressive because it is only applied to non-wage forms of income.', 'The tax is regressive because it is a flat tax that takes a smaller proportion of income as the income rises.']\",\"question\":\"How is the federal payroll tax that supports the Social Security program a regressive tax?\",\"src\":\"stemez-Economics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}