{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"aa748fea-a65e-52f5-827d-87ef9d175e64","task_key":"all--test--aa748fea-a65e-52f5-827d-87ef9d175e64","task_revision_id":"1","upstream_id":"","short_description":"A retiree owned a building in a city. Several years ago, an artist, in a signed…","config":"all","split":"test","body":"{\"choices\":\"['Eviction of the artist for non-payment of rent.', 'Recovery of the difference between the lease price and the fair market value of the leasehold for a year.', 'Recovery of double the rent prorated on a monthly basis for the number of months the artist was on the premises beyond the three- year period.', \\\"Require that the artist move out immediately or be held responsible for three years' rent.\\\"]\",\"question\":\"A retiree owned a building in a city. Several years ago, an artist, in a signed writing, entered a three- year lease agreement with the retiree. The artist agreed to pay $800 monthly rent for the third-floor apartment in the retiree's building. The original three-year term had long since expired, but the artist has continued to pay his rent, and the retiree continued to accept it. The building became infested with rats after a restaurant was opened in the adjacent building. The artist could not tolerate the rats and served notice on the retiree that he was moving to another city and has not been heard from since. At common law, what remedy was available to the retiree before she accepted the first rental payment after the end of the initial three-year period?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}