{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e5224b04-9fed-5550-86b1-785987af6e37","task_key":"all--test--e5224b04-9fed-5550-86b1-785987af6e37","task_revision_id":"1","upstream_id":"","short_description":"In a jurisdiction using the grantor €”grantee indices, the following events have…","config":"all","split":"test","body":"{\"choices\":\"['succeed, because the mortgage company is a third-party beneficiary of the agreement between the borrower and the daughter.', 'succeed, because there was an implied delegation of duties to the daughter.', 'not succeed, because the daughter did not promise to pay the mortgage debt.', 'not succeed, because the law does not permit the mortgagor to delegate duties under this type of a property transfer.']\",\"question\":\"In a jurisdiction using the grantor €”grantee indices, the following events have occurred in the order listed below:(1) In 1993, a borrower mortgaged a ranch to a mortgage company to secure a note for $25,000, due on December 31, 1993, with 9V2 percent interest per annum. (2) In 1996, the mortgage company recorded the mortgage on the ranch. (3) In 2007, in a signed writing, which the borrower delivered to his daughter, the borrower promised to convey the ranch to the daughter by a quitclaim deed and pay the mortgage debt when it came due. (4) In 2008, the borrower delivered to the daughter a quitclaim deed that made no reference to the mortgage. If the borrower thereafter defaulted on the mortgage and the mortgage company brought an in personam action against the daughter to recover the amount due on the mortgage debt, the mortgagee will probably\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}