{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9b2426a9-ed07-5737-89d9-2c8659e92d91","task_key":"default--test--1721","task_revision_id":"1","upstream_id":"1721","short_description":"A state legislature passed a law requiring state universities to have male and…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['Since the law does not affect a fundamental right or involve gender discrimination, the burden is on the plaintiffs to show that it is not rationally related to a legitimate governmental interest.', 'Since the law deals with the fundamental right of privacy, the state must show that it furthers a compelling state interest.', 'Since the law involves marital discrimination, the state must prove that the law is substantially related to an important state interest.', 'Since the law involves gender discrimination, the state must show that it furthers a compelling state interest.', 'Since the law involves gender discrimination, the state must prove that the law is substantially related to an important state interest.', 'Since the law deals with the freedom of association, the burden is on the plaintiffs to prove that it is not rationally related to a legitimate governmental interest.', 'Since the law deals with the freedom of association, the state must show that it furthers a compelling state interest.', 'Since the law involves privacy rights, the burden is on the plaintiffs to prove that it is not rationally related to a legitimate governmental interest.', 'Since the law affects the fundamental right to education, the state must show that it furthers a compelling state interest.', 'Since the law does not affect a fundamental right or involve marital discrimination, the burden is on the plaintiffs to show that it is not rationally related to a legitimate governmental interest.']\",\"question\":\"A state legislature passed a law requiring state universities to have male and female students live in separate dormitory facilities. The law was passed in order to curtail the increasing number of co-ed pregnancies on college campuses. Two students at a state university are engaged to be married and wish to share a dormitory room together. Citing the law, university housing officials refuse to allow them to live together in a campus dormitory facility. The students bring an appropriate action to challenge the constitutionality of the law. Which of the following correctly states the applicable burden of persuasion?\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}