{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d5837b93-e729-5c63-9c94-ca6582a01d31","task_key":"all--test--d5837b93-e729-5c63-9c94-ca6582a01d31","task_revision_id":"1","upstream_id":"","short_description":"A city imposes a municipal excise tax of $200 per year on commercial…","config":"all","split":"test","body":"{\"choices\":\"['constitutional, as a nondiscriminatory license tax.', 'constitutional, as within the powers of the state to tax the instruments of interstate commerce.', 'unconstitutional, as an undue burden on interstate commerce.', 'unconstitutional, as a discriminatory tax on the privilege of doing business within the state.']\",\"question\":\"A city imposes a municipal excise tax of $200 per year on commercial photographic studios in the city. It also imposes an excise tax of $100 per year on every itinerant commercial photographer for the privilege of using the streets and sidewalks. A credit is allowed against this latter tax for any excise tax paid to the city by the photographer or his employer in respect to the maintenance of a photographic studio in the city. In an action by a studio located in the city challenging the constitutionality of the $200 per year excise tax, the court will most likely declare the tax\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}