{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6f9b004e-68da-5d2e-8231-2e64d0e98a79","task_key":"all--test--6f9b004e-68da-5d2e-8231-2e64d0e98a79","task_revision_id":"1","upstream_id":"","short_description":"In recent years there has been much publicity regarding juries approving…","config":"all","split":"test","body":"{\"choices\":\"['unconstitutional, because Congress cannot enact legislation involving local matters, such as automobile accidents, unless it involves interstate commerce.', 'unconstitutional, because a limitation on damage awards in tort actions would violate the equal protection clause of the Fourteenth Amendment as applicable to the states by operation of the Fifth Amendment.', 'constitutional, because under Article III, Congress has plenary power to regulate the jurisdiction and scope ofjudicial review of federal and lower state courts.', 'constitutional, because under the supremacy clause, when there is a conflict between federal law and state law, the federal law preempts and takes precedence over the conflicting state law.']\",\"question\":\"In recent years there has been much publicity regarding juries approving excessively high multi- million dollar damage awards in personal injury actions. As a result, Congress enacted a statute that limited recovery in personal injury actions filed in state court(s) to $400,000, and punitive action recovery to a maximum of $750,000. A man was injured in an automobile accident when a car driven by a woman drove through a red light and struck his vehicle. The man was paralyzed from the accident and became a paraplegic. The man brought a personal injury action against the woman in state court. The jury returned a verdict on the man's behalf and awarded him $1,000,000 in damages. After the jury verdict, the woman filed an appeal challenging the amount of the award, claiming that it was excessive and violated the federal guidelines set forth in the statute. The man has filed suit challenging the constitutionality of the statute. The statute should be ruled\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}