{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cf38caf6-921d-58ed-97e5-92c09f03d9a9","task_key":"all--test--cf38caf6-921d-58ed-97e5-92c09f03d9a9","task_revision_id":"1","upstream_id":"","short_description":"A seller signed an agreement to sell a residential parcel to a prospective…","config":"all","split":"test","body":"{\"choices\":\"['Yes, because the seller breached the agreement by not following the procedure stated in the purchase agreement.', 'No, because the seller always has the right to bring an action for adverse possession against the holder of the open mortgage.', 'Yes, because the open mortgage is so old that it would be declared void by all courts.', 'No, because the buyer did not act in good faith when it refused to give the seller additional time at the closing.']\",\"question\":\"A seller signed an agreement to sell a residential parcel to a prospective purchaser. The agreement required her to convey good and marketable title. The title search revealed an open mortgage from a previous owner to a local bank. It was recorded 25 years ago. The mortgagor could not be found and the bank lost its records. The purchase agreement gave the seller 90 days extra in such a situation to clear title by bringing a quiet title action. The seller did not follow that provision and went to settlement with the bad title and demanded more extra time to file a quiet title action. The buyer decided not to wait and demanded her down payment be returned and that the deal be rescinded. Will litigation most likely favor the buyer's position?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}