{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d15e1b3f-f88a-5fd3-9f6f-0d9132d01f49","task_key":"all--test--d15e1b3f-f88a-5fd3-9f6f-0d9132d01f49","task_revision_id":"1","upstream_id":"","short_description":"A landowner, being owner in fee simple of a farm conveyed the property by…","config":"all","split":"test","body":"{\"choices\":\"['prevail, because the friend acquired title to the farm by quitclaim deed.', 'prevail, because the farmer was a third-party beneficiary under the conveyance between the investor and the friend.', 'not prevail, because the conveyance between the investor and the friend did not effectuate a delegation of duties.', 'not prevail, unless the land was subject to the mortgage.']\",\"question\":\"A landowner, being owner in fee simple of a farm conveyed the property by warranty deed to an investor. The investor gave a farmer a mortgage on the farm to secure a loan from the farmer to the investor in the amount of $50,000. The mortgage was recorded immediately. Two years later, the investor conveyed the farm to his friend by quitclaim deed. According to the deed instrument, the friend \\\"assumed the mortgage. \\\" The investor then defaulted on the mortgage, and the farmer brought an in personam action against the friend to recover the amount of the mortgage due. The farmer will most likely\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}