{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ce7d28ba-8537-563a-b24a-14dfba1374e5","task_key":"default--test--1792","task_revision_id":"1","upstream_id":"1792","short_description":"A seller and a buyer signed a contract of sale for improved real property. The…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['The buyer, because he executed both notes.', 'The bank, because it provided financing for the purchase of the property.', \\\"The seller, because he retained a vendor's lien that was first in time.\\\", 'The bank, because its loan satisfied the financing contingency in the contract of sale.', \\\"The seller, because the bank had actual knowledge of the seller's note.\\\", \\\"The seller, because the buyer's note to him was not secured by a mortgage.\\\", 'The bank, because it promptly recorded its mortgage.', 'The bank, because its note is secured by a purchase money mortgage.', 'The buyer, because he is the one in default on both notes.', \\\"The seller, because the bank's loan did not fully cover the purchase price.\\\"]\",\"question\":\"A seller and a buyer signed a contract of sale for improved real property. The contract contained a financing contingency for a certain percentage of the purchase price. The buyer obtained the requisite financing from a bank. At the closing, the buyer executed a note to the seller for a portion of the purchase price, which note was not secured by a mortgage. The buyer then executed a second note, secured by a mortgage to executed a second note, secured by a mortgage to the bank, applying the bank loan proceeds to the purchase price of the property. The bank had actual knowledge of the prior note to the seller. The bank promptly recorded its mortgage. The buyer is now in default on both notes. There is no applicable statute. Which party has priority?\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}