{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1cbd4b66-3ff6-57d4-bd43-7ad8a514ade6","task_key":"all--test--1cbd4b66-3ff6-57d4-bd43-7ad8a514ade6","task_revision_id":"1","upstream_id":"","short_description":"A state has enacted a criminal statute prohibiting the mailing of obscene…","config":"all","split":"test","body":"{\"choices\":\"['The method by which materials are marketed or advertised is not probative of whether they are obscene.', 'It is an unconstitutional invasion of privacy for the government to interfere with the content of closed mailings intended for the private use by consenting adults.', \\\"Under the First Amendment, the community's standards for children may not be applied in determining what constitutes obscenity for adults.\\\", 'Obscenity is to be determined by applying national standards, not contemporary community standards.']\",\"question\":\"A state has enacted a criminal statute prohibiting the mailing of obscene materials to any person. The owner of a publication company was prosecuted and convicted of violating the state obscenity law by mailing adults sexual literature that appealed to their prurient interests. During the owner's trial, the judge instructed the jury that determining if the mailed materials were obscene depended in part on whether they were offensive to the average or normal person under contemporary community standards, and that the community standards test must be considered in light of the fact that many children reside in the community. Furthermore, the judge instructed the jury that in determining whether the materials were obscene, it could also consider evidence of pandering, or whether the materials were marketed purposely to appeal to the recipients' prurient interest in sex. The owner appealed her conviction, alleging a denial of her First Amendment rights. Which of the following is the strongest argument why the appellate court should reverse the owner's conviction?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}