{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"65595d72-f2a0-5a86-b922-3a322ee601c3","task_key":"default--test--1082","task_revision_id":"1","upstream_id":"1082","short_description":"To improve the quality of rental housing within its boundaries, a city proposed…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['The city must demonstrate that the ordinance is necessary to serve a compelling state interest, because it adversely affects the fundamental right of rental housing owners to use their property in the manner they deem most economically efficient.', 'The city must demonstrate that the ordinance is necessary to serve a compelling state interest, because it will have a substantial and disproportionate negative impact on low-income persons.', 'The plaintiff must demonstrate that the ordinance is not substantially related to an important state interest, because it requires some owners of rental housing to invest money that they will not be able to recoup from increased rents.', 'The plaintiff must demonstrate that there is no rational relationship between the ordinance and any legitimate state interest, because the ordinance regulates economic activity of a type normally presumed to be within state regulatory authority.']\",\"question\":\"To improve the quality of rental housing within its boundaries, a city proposed an ordinance requiring all new and existing rental housing units to provide at least one full bathroom for each bedroom, plumbing and electrical hookups for a washer and dryer, and a covered parking space. A majority of the owners of existing rental housing in the city opposed the ordinance. They argued that it would dramatically decrease the number of lowincome rental housing units because owners would be unable to raise rents enough to recoup the investment required to comply. Without denying these contentions, the city enacted the ordinance. A plaintiff who owns low-income rental housing has sued the city, claiming only that the ordinance is unconstitutional on its face. Which of the following best states the burden of persuasion in this action?\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}