{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c0b4eb69-107d-58f6-8406-e1a211653b98","task_key":"all--test--c0b4eb69-107d-58f6-8406-e1a211653b98","task_revision_id":"1","upstream_id":"","short_description":"Assume this question takes place in a \"lien theory\" state. A woman and her…","config":"all","split":"test","body":"{\"choices\":\"['No, the mortgage lien could not destroy the joint tenancy, and when the partner dies, the property passes by operation of law to the surviving joint tenant.', 'No, although the mortgage destroyed the joint tenancy, the bank has to get a deed of trust in order to execute on jointly owned property.', 'Yes, the bank got title to the property by virtue of the mortgage, which destroyed the joint tenancy, and it can execute on its lien.', 'Yes, the mortgage was the equivalent of a deed of trust and the joint tenancy was severed by the mortgage lien, giving the bank unfettered legal authority to execute on its mortgage.']\",\"question\":\"Assume this question takes place in a \\\"lien theory\\\" state. A woman and her co-habiting partner share a property as joint tenants with the right of survivorship. He has run up debts that he did not tell her about, and so he uses his interest in the property to secretly get a mortgage from the bank. When he dies, the bank attempts to execute on the mortgage. Can it do so? Apply the majority view on this issue.\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}