{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c48853f7-12cb-5d60-a8d6-82531c47ab45","task_key":"all--test--c48853f7-12cb-5d60-a8d6-82531c47ab45","task_revision_id":"1","upstream_id":"","short_description":"A housing corporation owned a tract of land and prepared a development plan to…","config":"all","split":"test","body":"{\"choices\":\"['There is not privity of contract between the housing corporation and the community association.', \\\"Because the charge constitutes a lien, there is no personal obligation on the landscaper's part.\\\", 'There is no privity of contract between the gardener and the landscaper.', 'There is no privity of estate between the gardener and the landscaper.']\",\"question\":\"A housing corporation owned a tract of land and prepared a development plan to divide the land into 100 lots and create a residential community on the tract of land. The Declaration of Covenants created the community association, an administrative entity that would administer and enforce the regulations and restrictions recited among the covenants. One of the regulations set forth in the Declaration of Covenants reads:\\\"Each purchaser, by the acceptance of a deed therefore, promises to pay the community association an annual assessment or charge to be determined on the basis of the valuation of each individual lot and the improvements thereon. Nonpayment of any annual assessment or charge when due shall result in a lien upon the parcel of the property. \\\"A gardener, the owner of lot 29 in the development, sold his land to a landscaper with a deed containing no restrictions. The community association, pursuant the Declaration of Covenants, sues the landscaper to collect the annual assessment for lot 29. Which of the following is the best argument for the landscaper?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}