{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"db3e2261-d4f2-5e61-906c-e5ae1d56b65a","task_key":"default--test--1456","task_revision_id":"1","upstream_id":"1456","short_description":"A company got a building permit to construct a total of 300 apartment units to…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['Yes, the city cannot change zoning laws after issuing a building permit without compensating the developer.', 'No, the developer was aware of potential zoning changes and should have taken that into consideration.', \\\"No, the developer should have made a significant investment and appealed the city's decision.\\\", 'Yes, because he got a building permit and justifiably relied on that approval \\\\x80\\\\x93 the rezoning was an illegal act once it granted a building permit.', 'Yes, the developer had a right to construct the planned units as per the original permit.', 'Yes, because the new zoning law disproportionately affected the developer compared to other landowners.', 'No, the city has the right to rezone land for the greater good of the community.', \\\"Yes, because the developer's loss was caused by discriminatory spot zoning that took its property without due process.\\\", \\\"Yes, the state cannot cause such a dramatic diminution in an owner's property without paying just compensation.\\\", 'No, this was a comprehensive new zoning plan that rezoned the entire city; the developer shared the loss with the adjoining owners who were also rezoned.']\",\"question\":\"A company got a building permit to construct a total of 300 apartment units to be contained in three high-rise buildings on its 7-acre property. A group of adjoining landowners who owned single-family residences sued for an injunction, alleging various environmental violations. The developer did not have a significant investment at that point, and decided to stop the construction.Shortly thereafter, the city passed a comprehensive new citywide zoning law that re-zoned the subject property and some large tracts of adjoining land to low-density residential, allowing one residence for each 4.6 acres. This destroyed the multi-unit plan and the city cancelled the permit, which the developer did not appeal.The developer's land value decreased from $2 million to $100,000.The developer sued the city in federal court on the basis that this was illegal spot zoning constituting a taking in violation of due process.Will the developer prevail with his federal constitutional claim?\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}