{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b001f2c1-4871-5a60-b68e-ad95b763c544","task_key":"all--test--b001f2c1-4871-5a60-b68e-ad95b763c544","task_revision_id":"1","upstream_id":"","short_description":"A property owner owned a 30-acre tract of land located on the outskirts of a…","config":"all","split":"test","body":"{\"choices\":\"['not prevail, because the president was acting to protect a legitimate public interest.', 'not prevail, because the statement involves only an expression of opinion.', 'prevail, because the president obviously acted with malice by sending the letter to the newspaper.', \\\"prevail, because the language of the president's letter would be highly offensive to reasonable persons.\\\"]\",\"question\":\"A property owner owned a 30-acre tract of land located on the outskirts of a community. After prosperity burst upon the community, the property owner subdivided the property into 30 lots and built townhouses on each of the lots. After selling all 30 of the lots, the various homeowners formed a homeowners' association. Thereafter, the homeowners' association adopted a Declaration of Covenants, which provided, inter alia, that each homeowner was required to pay an annual assessment charge to be used \\\"for the promotion of the health, safety, and welfare of residents within the subdivision and for the enhancement of education, social life, and community welfare. \\\"The homeowners' association then properly and legally assessed each homeowner an assessment charge of $750. An owner of a townhouse in the subdivision refused to pay the assessment. The townhouse owner was experiencing financial problems and claimed that she couldn't afford to pay the $750. As a result, the president of the homeowners' association sent the townhouse owner the following letter:\\\"Article 1 of the Declaration of Covenants requires all homeowners to pay their annual assessment charge on the first day of January for the said year. Because of your failure to make this payment, the homeowners' association shall have the right to collect the amount due by action of law. Your prompt attention to this matter is greatly appreciated. \\\"Three weeks elapsed, and the president of the homeowners' association did not receive any response from the townhouse owner. He then wrote her a second letter that stated:\\\"Before it institutes legal action, this is the homeowners' association's final demand for your $750 assessment charge. It is unfortunate that deadbeats like you ruin our community. \\\"A copy of this letter was mailed to the other29 residents of the development. The presidenteven sent a copy of the letter to the editor of thecounty newspaper, which had a circulation of20,000 subscribers. In its next edition, the countynewspaper published the president's letter on itseditorial page. If the townhouse owner sues the president for defamation, she will probably\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}