{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a4c0b120-a3b3-5499-b858-4692fefc6159","task_key":"default--test--1961","task_revision_id":"1","upstream_id":"1961","short_description":"Congress has recently enacted a statute designed to prevent price gouging of…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['Congress may not delegate to the agency power to interpret regulations without the approval of the President.', 'Congress may not delegate to the agency power to issue fines.', 'Congress may not delegate to the agency power to imprison private citizens.', 'Congress may not delegate enforcement of a federal law in any governmental body other than the U. S. Attorney General or the courts.', 'Congress may not delegate to the agency power to make \\\"cease and desist\\\" orders, the violation of which is punishable by imprisonment.', 'Congress may not delegate to the agency power to make interpretations of existing federal laws.', 'Congress may not create an agency to regulate private business practices.', 'Congress may not delegate to the agency power to regulate prices.', 'Congress may not retain the power to appoint even a minority of members of such an agency.', 'Congress may not delegate power to an agency without the approval of the Supreme Court.']\",\"question\":\"Congress has recently enacted a statute designed to prevent price gouging of gasoline by private retail sellers. To help administer the new statute Congress created a seven-member agency, four members of which were appointed by the President, two by the Senate, and one by the Speaker of the House. The agency was authorized to issue rules interpreting regulations prescribed under existing federal law. It was also authorized to issue \\\"cease and desist\\\" orders after hearings against private retail sellers of gasoline who \\\"intentionally engaged in price gouging. \\\" In this regard, violations of the cease and desist orders were made punishable by fine and/or imprisonment. Which of the following is the strongest constitutional argument against the authority of this agency?\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}