{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"21e97dd8-b15e-5998-8589-d082e083f2f8","task_key":"all--test--21e97dd8-b15e-5998-8589-d082e083f2f8","task_revision_id":"1","upstream_id":"","short_description":"A state has recently enacted a statute prohibiting the sale of computer printer…","config":"all","split":"test","body":"{\"choices\":\"['Refuse to review this case on the merits because there is an adequate and independent state ground for the decision rendered below.', 'Reverse the decision on the merits with respect to the state constitutional issue because the federal constitutional holding rendered below makes such a state constitutional decision unnecessary.', 'Affirm the decision on the merits with respect to the federal constitutional issue and abstain from reviewing the state constitutional issue.', 'Affirm the decision on the merits with respect to both the federal and state constitutional issues because the state constitution must substantially conform with the federal constitution on this issue.']\",\"question\":\"A state has recently enacted a statute prohibiting the sale of computer printer ink cartridges in plastic bags. In accordance with the new law, all ink cartridges within the state must be sold in paper cartons that are recyclable. Before the passage of the law, approximately 28% of all ink cartridges used in the state was packaged in plastic bags. Of that total, 75% of the ink cartridges was packaged outside the state, while 25% was packaged by companies in-state. The legislature passed the bill at the strong urging of the paper industry. It was estimated that one paper company alone spent over $5,000,000 in its lobbying campaign for the passage of the bill. Ironically, the new law even received strong support from environmentalists who believed that recyclable paper would help prevent littering. Assume that the state Supreme Court adjudges the law to be unconstitutional on the grounds that it violates the contracts clauses of both the federal and the state Constitutions. The contracts clause of the state Constitution is similar to the one in the federal Constitution. The court so held because, in its judgment, the statute retroactively impairs the ability of plastic bag packagers to honor their existing contracts for the sale of ink cartridges packaged in plastic bags. The state attorney general now seeks review of this decision in the U. S. Supreme Court. How should the U. S. Supreme Court rule on this case?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}