{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"75cbf8c3-a439-5d50-a399-879c2ba3c164","task_key":"all--test--75cbf8c3-a439-5d50-a399-879c2ba3c164","task_revision_id":"1","upstream_id":"","short_description":"Four people own a property, and they agree to convey to an adult child of one of…","config":"all","split":"test","body":"{\"choices\":\"['Yes, that is the risk the purchaser took; he cannot go to closing without a title search and a title company making arrangements for payment of the outstanding mortgage by the seller at closing.', 'Yes, because the court can only force the original four owners to clear the mortgage by paying it in full.', 'No, the court will order the original four owners to come into court and defend on behalf of the adult child, who has no legal responsibility for the mortgage.', 'No, the court will order the adult child to resume paying on the mortgage and to obtain a loan to pay it off within a reasonable time.']\",\"question\":\"Four people own a property, and they agree to convey to an adult child of one of them. There is a purchasemoney mortgage on the property for which the four signed a promissory note as security. The loan was not satisfied at the time of the conveyance. The conveyance is a deed in fee simple to the adult child. The adult child then takes over the mortgage payments. The adult child stops making the payments and conveys the property to a bona fide purchaser who does not do a title search. The purchaser sues his grantor to get an order compelling him to pay the mortgage and remove the lien from his property. Will the court more than likely grant the motion to dismiss made by the defendants?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}