{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8b360b55-dcc3-5b11-8046-38aff6e6ea6c","task_key":"default--test--1602","task_revision_id":"1","upstream_id":"1602","short_description":"A city designed an economic development plan to foster downtown revitalization…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"[\\\"The taking would primarily increase the business corporation's profit margins, which is insufficient to support the public use requirement.\\\", 'The taking is proper because the creation of new jobs is a tangible public benefit.', \\\"The Supreme Court will not decide as it doesn't have jurisdiction over local land disputes.\\\", \\\"The taking is improper because the property owners' rights outweigh the city's economic development plans.\\\", \\\"The taking for economic development purposes is proper because developing the city's economy constitutes a public use.\\\", \\\"The Supreme Court will defer to the city's judgment as to what constitutes a public use.\\\", 'The taking is proper because the increase in tax revenue is a direct public benefit.', 'The taking is improper because the government did not negotiate with the property owners in good faith.', 'The taking is improper because the major benefit will go to a private company and this contradicts the public use requirement.', \\\"The taking is improper because a private industry research center is not primarily open to the public's use.\\\"]\",\"question\":\"A city designed an economic development plan to foster downtown revitalization efforts. The city's agent got a commitment from a major business corporation to build a large research center in the targeted area, which would bring new jobs and increased tax revenue. The city brought eminent domain proceedings to free up some 200 acres of land in the selected area. Although the city successfully condemned most of the privately-owned properties, it failed to reach agreement with nine residential property owners. Those owners brought suit seeking an injunction to prevent the taking. They claimed that this was not a taking for \\\"public use\\\" as required by the takings clause of the Fifth Amendment; rather the government was taking their property to give it to a private company. The case reached the Supreme Court of the United States. What will the Supreme Court decide?\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}