{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0fdc5b53-6aa9-52ba-a5f6-7378f33617a3","task_key":"default--test--1832","task_revision_id":"1","upstream_id":"1832","short_description":"A state has enacted a statute imposing a tax on the extraction of all platinum…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['The state must convince the court that the tax is rationally related to the advancement of a compelling state interest.', 'The state must convince the court that the classification in the statute is not necessary to advance a legitimate state interest.', 'The mining company must convince the court that the classification in this statute is the least restrictive means by which to advance a compelling state interest.', 'The state must convince the court that the classification in the statute is necessary to advance a compelling state interest.', 'The mining company must convince the court that the tax is not necessary to advance a legitimate state interest.', 'The state must convince the court that the classification in this statute is the least restrictive means by which to advance a compelling state interest.', 'The mining company must convince the court that the classification in this statute is not rationally related to the advancement of a legitimate state interest.', 'The mining company must convince the court that the classification in this statute is not necessary to advance a compelling state interest.', 'The state must convince the court that the classification in the statute is rationally related to the advancement of a legitimate state interest.', 'The mining company must convince the court that the classification in this statute is the most restrictive means by which to advance a legitimate state interest.']\",\"question\":\"A state has enacted a statute imposing a tax on the extraction of all platinum in the state. The extraction of other minerals is not taxed by the state. This is true even though there is considerable mining of silver, turquoise, sulfur, and stone within the state. As a result, the largest platinum mining company in the state has filed suit challenging the constitutionality of the state's platinum tax statute. Which of the following best states the burden of persuasion if the mining company attacks the statute as violating the equal protection of the laws?\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}