{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"67142d19-6f60-5e4a-b184-a6e3b9609d36","task_key":"all--test--67142d19-6f60-5e4a-b184-a6e3b9609d36","task_revision_id":"1","upstream_id":"","short_description":"A corporation owns a shopping mall that includes a grocery store. The union that…","config":"all","split":"test","body":"{\"choices\":\"['No, under the mantle of authority test there are not enough connections between the state and the private actions of the mall and the store.', 'No, because a private actor can never be held liable in a constitutional rights claim that requires state action.', 'Yes, because the equal protection balancing test shows that there is state action in renting the property to private actors who are discriminating.', 'Yes, because First Amendment violations require strict scrutiny, and here the connection between the state and the mall cloaks the mall and store with state action status.']\",\"question\":\"A corporation owns a shopping mall that includes a grocery store. The union that bags fruit wants to strike in front of the store, even though it is in the mall. The mall has a Social Security Office and the real estate is owned by the state. The grocery store pays rent to the state. Any type of picketers are prevented from entering the mall to picket inside by the owners of the mall, who also pay rent to the state for the land, and there is no outside entrance of the store at the mall where the picketers could strike. If the picketers go before the court to claim violations of First and Fourteenth Amendment rights, will state action likely be found against the store and the mall owners?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}