{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1b198acf-2bbc-50ed-b635-24c6c9de9d7e","task_key":"all--test--1b198acf-2bbc-50ed-b635-24c6c9de9d7e","task_revision_id":"1","upstream_id":"","short_description":"A homeowner gave his friend a mortgage on his property to secure a loan from the…","config":"all","split":"test","body":"{\"choices\":\"['$0. 00', '$30,000. 00', '$80,000. 00', '$100,000. 00']\",\"question\":\"A homeowner gave his friend a mortgage on his property to secure a loan from the friend to the homeowner in the amount of $100,000. The homeowner then gives an investor a mortgage on the property to secure a loan from the investor to the homeowner in the amount of $80,000. The friend then records his mortgage. The homeowner then gives a bank a mortgage on the property to secure a loan from the bank to the homeowner in the amount of $50,000. The investor then records. The bank then records. The homeowner lost his job and was unable to pay the mortgages on the property. In a foreclosure proceeding in which the friend, the investor, and the bank were parties, the property sold for $160,000. The recording statute in this jurisdiction provided \\\"unless recorded, all written instruments affecting title to land are void as to subsequent purchasers who paid value and without notice. \\\"What dollar amount, if any, should go to the friend?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}