{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ffd689eb-d9f7-5bba-a41b-e6849d15a57b","task_key":"all--test--ffd689eb-d9f7-5bba-a41b-e6849d15a57b","task_revision_id":"1","upstream_id":"","short_description":"A large privately owned and operated shopping mall is open to the public and…","config":"all","split":"test","body":"{\"choices\":\"['No, because the mall is private property, and there was no state action to which the freedom of speech guarantees of the First and Fourteenth Amendments apply.', 'No, because the prohibition of protests adjacent to the entrance of a department store during shopping hours is a constitutionally proper limitation on the time, place, and manner of speech.', \\\"Yes, because the mall is functionally equivalent to a town and, therefore, its actions are subject to the Constitution's guarantees of freedom of speech and assembly.\\\", \\\"Yes, because the mall's restriction on the protesters' speech was broader than necessary to ensure proper access to the department store.\\\"]\",\"question\":\"A large privately owned and operated shopping mall is open to the public and includes small shops, major department stores, and restaurants that are located around a pedestrian area. It also has several movie theaters, an ice-skating rink, a small amusement park, and a branch of the local public library. The mall is advertised as \\\"a small town with a big-town feel.\\\" During shopping hours, a group of 10 protesters gathered in the pedestrian area near the entrance to a department store to denounce the sale of animal fur products in that store. The protesters were peaceful and did not interfere with traffic into or out of the store, but they carried signs and vocally communicated their message to people walking in the area. Mall management quickly broke up the protest and required the protesters to leave the mall. The protesters have sued the mall, claiming that their right to freedom of speech guaranteed by the First and Fourteenth Amendments was violated. Should the protesters prevail?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}