{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6deaffc0-bc4f-5238-9be1-a4bdef388d19","task_key":"default--test--1300","task_revision_id":"1","upstream_id":"1300","short_description":"Assume this question takes place in a \"lien theory\" state. A woman and her…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['No, although the mortgage destroyed the joint tenancy, the bank has to get a deed of trust in order to execute on jointly owned property.', \\\"No, the bank cannot execute on the mortgage because the property was jointly owned and one partner cannot unilaterally mortgage the property without the other's consent.\\\", \\\"No, the bank cannot execute on the mortgage because the woman has the right of survivorship, which overrides the partner's debts.\\\", \\\"Yes, the bank can execute on the mortgage because the partner's debt is considered a lien on the property, which overrides the joint tenancy.\\\", 'Yes, the bank can execute on the mortgage because the partner used his interest in the property as collateral for the loan.', 'Yes, the bank can execute on the mortgage because the joint tenancy is considered severed when one partner incurs a debt without the knowledge of the other.', 'Yes, the bank got title to the property by virtue of the mortgage, which destroyed the joint tenancy, and it can execute on its lien.', 'Yes, the mortgage was the equivalent of a deed of trust and the joint tenancy was severed by the mortgage lien, giving the bank unfettered legal authority to execute on its mortgage.', 'No, the mortgage lien could not destroy the joint tenancy, and when the partner dies, the property passes by operation of law to the surviving joint tenant.', 'No, the bank cannot execute on the mortgage because the majority view in a \\\"lien theory\\\" state is that a mortgage does not sever a joint tenancy.']\",\"question\":\"Assume this question takes place in a \\\"lien theory\\\" state. A woman and her co-habiting partner share a property as joint tenants with the right of survivorship. He has run up debts that he did not tell her about, and so he uses his interest in the property to secretly get a mortgage from the bank. When he dies, the bank attempts to execute on the mortgage. Can it do so? Apply the majority view on this issue.\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}