{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a810c7a8-6dac-52b3-8b7e-bcc854509687","task_key":"default--test--1675","task_revision_id":"1","upstream_id":"1675","short_description":"Congress recently enacted a statute that prohibits racial discrimination in the…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['The commerce clause of Article I.', 'The enforcement provision of Section 5 of the Fourteenth Amendment.', 'Under Article I, Congress has the power to enact laws that are \\\"necessary and proper\\\" to the general welfare.', 'The enforcement provision of Section 1 of the Nineteenth Amendment.', 'The privileges and immunities clause of the Fourteenth Amendment.', 'The enforcement provision of Section 2 of the Fifteenth Amendment.', 'The enforcement provision of Section 2 of the Thirteenth Amendment.', 'The equal protection clause of the Fourteenth Amendment.', 'The due process clause of the Fifth Amendment.', 'The supremacy clause of Article VI.']\",\"question\":\"Congress recently enacted a statute that prohibits racial discrimination in the sale, transfer, or rental of real estate, either privately or publicly. Which of the following constitutional provisions would provide the best rationale for the enactment of this federal statute?\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}