{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5b534ee2-f70e-5f3a-aa1d-80fcc4777b90","task_key":"all--test--5b534ee2-f70e-5f3a-aa1d-80fcc4777b90","task_revision_id":"1","upstream_id":"","short_description":"A developer leased with an option a 250-acre property from a widow who retained…","config":"all","split":"test","body":"{\"choices\":\"['Yes, under equitable conversion the seller is trustee for the buyer and is responsible for the risk of loss.', 'Yes, the developer had an equitable ownership interest in the property when it exercised its option and the seller must compensate for loss to that interest.', 'No, the buyer acquired no equitable interest in the land or buildings until it exercised the option right before it expired; the court will order the sale at the full price without credit.', 'No, the buyer gets no credit for the house because it was renting the land at the time of the fire and it is responsible for waste.']\",\"question\":\"A developer leased with an option a 250-acre property from a widow who retained the right to live in a farmhouse on the land until her death. At her death, developer had a two-year option to buy for $100,000. Shortly after her death, the farmhouse was destroyed by a fire. The developer sent a letter almost two years later in which it exercised the option. The estate refused to sell. The developer brought suit on the option and for the first time claimed a $20,000 credit for destruction of the farmhouse. The court in equity granted the developer's claim and ordered a sale for $80,000. The estate of the widow appealed. Will the appellate court affirm the equity court's ruling and order the $20,000 credit to the developer for the loss of the house?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}