{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f7cdfed6-7f6c-5cf1-9894-3c9fecb7c851","task_key":"default--test--1921","task_revision_id":"1","upstream_id":"1921","short_description":"A city imposes a municipal excise tax of $200 per year on commercial…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['unconstitutional, as an undue burden on interstate commerce.', 'unconstitutional, as a discriminatory tax on the privilege of doing business within the state.', \\\"constitutional, as it is within the city's rights to tax local businesses.\\\", 'unconstitutional, as it infringes on the rights of local businesses.', 'constitutional, as it is a fair method of raising municipal revenue.', 'unconstitutional, as it is a form of double taxation.', 'constitutional, as within the powers of the state to tax the instruments of interstate commerce.', \\\"constitutional, as it is a reasonable exercise of the city's taxing power.\\\", 'unconstitutional, as it unfairly targets a specific profession.', 'constitutional, as a nondiscriminatory license tax.']\",\"question\":\"A city imposes a municipal excise tax of $200 per year on commercial photographic studios in the city. It also imposes an excise tax of $100 per year on every itinerant commercial photographer for the privilege of using the streets and sidewalks. A credit is allowed against this latter tax for any excise tax paid to the city by the photographer or his employer in respect to the maintenance of a photographic studio in the city. In an action by a studio located in the city challenging the constitutionality of the $200 per year excise tax, the court will most likely declare the tax\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}