{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5dcd9a47-c329-53dc-9ffa-9f58bd6937c5","task_key":"all--test--5dcd9a47-c329-53dc-9ffa-9f58bd6937c5","task_revision_id":"1","upstream_id":"","short_description":"A landlord owns a three-story building. The landlord leased the building and the…","config":"all","split":"test","body":"{\"choices\":\"['the landlord, because a tenant remains liable to pay rent, even though as a result of the fire, the property was rendered uninhabitable.', 'the landlord, because the covenant to pay rent runs with the land.', 'the tenant, because it would be inequitable to enforce the rental provision in the lease because the premises was rendered uninhabitable.', 'the tenant, because an increasing number of states have enacted statutes relieving a tenant of his obligation to pay rent where the premises are rendered uninhabitable by fire or other acts of God.']\",\"question\":\"A landlord owns a three-story building. The landlord leased the building and the surrounding property to a tenant for a term of six years, commencing on December 1, 2003 and terminating on November 30, 2009. On April 15, 2004, a neighbor, who owned an adjoining parcel of land, was burning leaves and underbrush on his land. There was a high wind blowing in the direction of the land that the landlord leased to the tenant, and the wind carried the burning leaves onto the tenant's property. The building caught fire and caused $150,000 in fire damages. Because of the fire, the tenant has not occupied the leased premises since the date of the fire because the building was rendered uninhabitable. This state is a common law jurisdiction. In addition, the controlling Statute of Limitations for initiating an action for damages due to negligence is five years from the time the cause of damage occurs. On May 1, 2004, the landlord brings suit against the tenant asserting breach of contract for failing to pay the rent. Judgment should be for\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}