{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d3790d5b-46f7-5e9e-a7f0-7a77a76ce026","task_key":"default--test--1239","task_revision_id":"1","upstream_id":"1239","short_description":"An investor owned a four-story office building located in downtown. The building…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['the investor, but only if the investor can establish that the mortgage takes precedence over the deed absolute because it was executed earlier in time.', 'the friend, because the deed absolute effectuated an outright conveyance that extinguished the redemption interest sought to be retained by the investor.', 'the friend, because the investor has no right to redeem after the deed absolute was executed.', 'the friend, if the friend can establish that the deed absolute was executed later in time.', 'the investor, because the deed absolute did not extinguish his right of redemption.', 'the friend, because the investor failed to pay his promissory note at maturity.', 'the investor, because the friend refused to accept the $125,000 indebtedness.', 'the investor, if the investor can prove that the deed was intended only as additional security for the payment of the debt.', 'the investor, because the deed absolute was not intended as an outright conveyance upon default.']\",\"question\":\"An investor owned a four-story office building located in downtown. The building was old and badly in need of renovation. To finance the improvements, the investor borrowed $125,000 from his friend. As consideration for the loan, the investor executed a promissory note for $125,000 payable to the friend in one year and secured by a mortgage on the building. The mortgage was dated January 1, and was recorded January 2. Thereafter, on February 1, the investor executed a deed absolute on the building and named the friend as grantee. This deed, although absolute in form, was intended only as additional security for the payment of the debt. In order to make judicial foreclosure unnecessary and to eliminate the right to redeem, the investor then delivered the deed to his nephew in escrow with instructions to deliver the deed to the friend if the investor failed to pay his promissory note at maturity. On January 1 of the following year, the investor failed to pay the note when it came due. Thereupon, the nephew, in accordance with the escrow instructions, delivered the investor's deed on the office building to the friend, which the friend promptly and properly recorded. Two weeks later, the investor tendered the $125,000 indebtedness to the friend. When the friend refused to accept it, the investor brought an appropriate action to set aside and cancel the deed absolute and to permit the redemption of the building from the friend. Conversely, the friend counterclaimed to quiet title and argued that the deed absolute was intended as an outright conveyance upon default. The court should enter a judgment that will grant the relief sought by\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}