{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8640a686-380f-5aaf-bdc3-29d964e11f19","task_key":"default--test--943","task_revision_id":"1","upstream_id":"943","short_description":"A state has passed a law that provides that only residents of the state who are…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['The privileges and immunities clause of the Fourteenth Amendment.', 'The commerce clause under Article I, Section 8.', 'The due process clause of the Fifth Amendment.', 'The equal protection clause of the Fourteenth Amendment.', 'The free exercise clause of the First Amendment.', 'The privileges and immunities clause under Article IV, Section 2.', 'The national property power provision under Article IV, Section 3.', 'The contract clause prohibition against a state from enacting any law that will impair the obligation of contracts.', 'The establishment clause of the First Amendment.', 'The takings clause of the Fifth Amendment.']\",\"question\":\"A state has passed a law that provides that only residents of the state who are citizens of the United States can own agricultural land in the state. A out- of-state farmer who is a U. S. citizen has contracted, subsequent to the aforementioned law, to purchase a farm from a landowner, which is located in the state. The landowner, who is a resident of the state, has been informed by his attorney that his sales agreement with the farmer is null and void under state law. Which of the following is the best constitutional argument to contest the validity of the state statute?\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}