{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"82ed144c-76b4-59d6-8374-af7e6d56ee79","task_key":"default--test--1818","task_revision_id":"1","upstream_id":"1818","short_description":"A city imposes a tax on nonresident's city derived income above $1,700 at a 3%…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"[\\\"The Eighth Amendment's prohibition of cruel and unusual punishment.\\\", 'The privileges and immunities clause of ArticleIV.', \\\"The Fourteenth Amendment's due process clause.\\\", \\\"The First Amendment's freedom of speech clause.\\\", \\\"The Tenth Amendment's reservation of powers to the states.\\\", \\\"The Second Amendment's right to bear arms.\\\", \\\"The Fifth Amendment's protection against self-incrimination.\\\", 'The commerce clause.', \\\"The Sixth Amendment's right to a speedy trial.\\\"]\",\"question\":\"A city imposes a tax on nonresident's city derived income above $1,700 at a 3% rate, except that if the nonresident's state of residence would impose a lesser tax had the income been earned in that state, the city tax would be reduced to that amount. This income tax exempts taxable income earned by city residents outside of the state. Moreover, residents of the city were not taxed on their in-city earned income. A commuter who works in the city but is a resident of a neighboring state, challenges the constitutionality of this statute. Which of the following provisions would furnish the most applicable basis for this constitutional challenge?\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}