{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a937ca68-e0eb-51e0-8a95-1c13fd55f2ea","task_key":"all--test--a937ca68-e0eb-51e0-8a95-1c13fd55f2ea","task_revision_id":"1","upstream_id":"","short_description":"A county owns a large expanse of land next to the ocean. Four years ago, in…","config":"all","split":"test","body":"{\"choices\":\"['The company will prevail because its denial of membership lacks the requisite state action.', 'The plaintiff will win because even though the company is a privately owned corporation, the state has affirmatively encouraged or facilitated its discriminating acts.', 'The company will win, because the plaintiff lacks standing to assert the rights of discrimination against white Americans as a group.', 'The plaintiff will win, because denial of membership to white residents cannot be justified by a rational basis.']\",\"question\":\"A county owns a large expanse of land next to the ocean. Four years ago, in order to enhance the recreational aspects of the land, the county leased most of it to a private company. The lease required the company to construct and operate a first-rate golf course and country club €”complete with bar, restaurant, and private marina €”and to pay the county 15% of its net profits as rent. The company set up bylaws, which were reviewed and approved by the county at the time the lease was negotiated. According to the bylaws, the golf course and country club, complete with its restaurant and bar, would be open to members only, and the membership committee is empowered to set up strict membership \\\"standards,\\\" as well as the cost of membership fees and dues. Upon completion of the facilities, the state granted the company a license to sell alcoholic beverages in its restaurant and bar. The membership committee announced that the membership fee is $5,000 and the monthly dues $75 per month. Furthermore, the membership committee had a policy of approving only membership applications for Latino Men, while disapproving and denying all applications of women, African Americans, white Americans, and other minorities. A white resident of the county, upon denial of membership, brings an action against the company seeking injunctive relief to compel his admission claiming that denial of membership to white residents violates his right to equal protection. Which of the following statements is most accurate?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}