{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2418edce-c4a6-5d59-9202-ededc51eb1e8","task_key":"default--test--955","task_revision_id":"1","upstream_id":"955","short_description":"A law in one state forbids the transportation or sale of tomatoes in the state…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"[\\\"There is no preemption because the first state's law does not contradict the federal law and both laws could be complied with simultaneously.\\\", 'When it comes to fresh produce, federal laws will always preempt state laws, and the injunction will be granted for that reason.', 'The injunction will be granted because tomatoes that are in compliance with federal law never have to be approved also under a state law.', 'Preemption does not apply here because agricultural regulations are generally left to the states.', \\\"The first state's law sets standards that interfere impermissibly with the second state's law and therefore the first state's law is preempted.\\\", \\\"The injunction will be granted because the first state's law contradicts the intent of Congress in setting uniform national standards.\\\", 'The injunction will be granted because the federal law implicitly preempts any state law on the same subject matter.', \\\"The injunction will be granted because the first state's law is violating the Commerce Clause by affecting interstate commerce.\\\", \\\"There is preemption because the first state's law is more stringent than federal law and therefore it cannot coexist.\\\", \\\"The injunction will not be granted because the first state's law is a legitimate exercise of its police powers to protect public health.\\\"]\",\"question\":\"A law in one state forbids the transportation or sale of tomatoes in the state that have a more than 10% \\\"genetic engineering factor.\\\" The U.S. Department of Agriculture does not use or mention genetic engineering factors in its standards for the sale and transportation of tomatoes. Tomato growers in a second state wish to ship tomatoes for sale into the first state but its tomatoes are in compliance only with the federal standards. The tomato growers' association in the second state brought an injunctive action in federal court against the agricultural department of the first state to enjoin enforcement of the genetic engineering rule on the basis of federal preemption. According to U.S. Supreme Court precedent, how will the courts decide the preemption claim?\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}