{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2c8d3c56-314e-5c2f-ab94-7787386c35c2","task_key":"all--test--2c8d3c56-314e-5c2f-ab94-7787386c35c2","task_revision_id":"1","upstream_id":"","short_description":"A group of women employed by a state government recently sued the state under…","config":"all","split":"test","body":"{\"choices\":\"['There is no sovereign immunity due to the First Amendment rights of the women to protest against discrimination.', 'There is sovereign immunity that protects a state from any lawsuit by private citizens that the state does not authorize.', 'There is no sovereign immunity where the federal law provides a remedy to women in a civil rights law intended to apply the Fourteenth Amendment enforcement rights against the states.', 'There is sovereign immunity under the Supremacy Clause and it would take a new constitutional amendment to abrogate the immunity granted to the states.']\",\"question\":\"A group of women employed by a state government recently sued the state under Title VII of the Civil Rights Act of 1964, on the basis of allowing the creation of a hostile work environment against them. An amendment to that act extends coverage to the states as employers. The federal district court allowed an injunction to prevent further discrimination but refused to allow money damages and legal fees against the state on the basis of 11th Amendment sovereign immunity. The plaintiffs appealed. What should the Court of Appeals decide based on the established jurisprudence regarding sovereign immunity?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}