{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5e545a2c-7ec5-501e-9929-3513e6230cb8","task_key":"all--test--5e545a2c-7ec5-501e-9929-3513e6230cb8","task_revision_id":"1","upstream_id":"","short_description":"A company got a building permit to construct a total of 300 apartment units to…","config":"all","split":"test","body":"{\"choices\":\"[\\\"Yes, the state cannot cause such a dramatic diminution in an owner's property without paying just compensation.\\\", 'Yes, because he got a building permit and justifiably relied on that approval \\\\x80\\\\x93 the rezoning was an illegal act once it granted a building permit.', \\\"Yes, because the developer's loss was caused by discriminatory spot zoning that took its property without due process.\\\", 'No, this was a comprehensive new zoning plan that rezoned the entire city; the developer shared the loss with the adjoining owners who were also rezoned.']\",\"question\":\"A company got a building permit to construct a total of 300 apartment units to be contained in three high-rise buildings on its 7-acre property. A group of adjoining landowners who owned single-family residences sued for an injunction, alleging various environmental violations. The developer did not have a significant investment at that point, and decided to stop the construction.Shortly thereafter, the city passed a comprehensive new citywide zoning law that re-zoned the subject property and some large tracts of adjoining land to low-density residential, allowing one residence for each 4.6 acres. This destroyed the multi-unit plan and the city cancelled the permit, which the developer did not appeal.The developer's land value decreased from $2 million to $100,000.The developer sued the city in federal court on the basis that this was illegal spot zoning constituting a taking in violation of due process.Will the developer prevail with his federal constitutional claim?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}