{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c06ea477-a6cc-5c79-a65c-cfc2e26aacd5","task_key":"all--test--c06ea477-a6cc-5c79-a65c-cfc2e26aacd5","task_revision_id":"1","upstream_id":"","short_description":"A plat restriction in a residential subdivision stated that \"no structure shall…","config":"all","split":"test","body":"{\"choices\":\"['No, the wording is ambiguous and therefore any use is now permitted.', 'The wording only restricts the building of the structure and does not restrict its later use so that the owner is entitled to change the use.', 'The intention was to enforce a residential use of the property so that the intended change in use will not be allowed.', 'A professional use of a building cannot be prohibited by a land restriction.f']\",\"question\":\"A plat restriction in a residential subdivision stated that \\\"no structure shall be built except for dwelling purposes.\\\" A dwelling was erected on one of the lots. Later, the owner of the dwelling attempted to use it as a dental office. The other owners in the subdivision asked the court to enjoin the intended use. Leaving aside zoning issues, will the court likely grant the request to prohibit the intended use?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}