{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a627be1e-448f-5b73-b54b-e64a2b656b08","task_key":"default--test--919","task_revision_id":"1","upstream_id":"919","short_description":"In a jurisdiction using the grantor €”grantee indices, the following events have…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['not succeed, because the daughter was not a party to the original mortgage contract.', 'succeed, because the mortgage company has the right to seek payment from any party associated with the property.', 'succeed, because there was an implied delegation of duties to the daughter.', 'succeed, because the mortgage company is a third-party beneficiary of the agreement between the borrower and the daughter.', 'not succeed, because the daughter did not promise to pay the mortgage debt.', 'succeed, because the daughter took ownership of the property with the quitclaim deed.', 'not succeed, because the mortgage company did not record the mortgage until 1996.', 'not succeed, because the daughter was only promised the property, not the debt.', 'succeed, because the borrower defaulted on the mortgage.', 'not succeed, because the law does not permit the mortgagor to delegate duties under this type of a property transfer.']\",\"question\":\"In a jurisdiction using the grantor €”grantee indices, the following events have occurred in the order listed below:(1) In 1993, a borrower mortgaged a ranch to a mortgage company to secure a note for $25,000, due on December 31, 1993, with 9V2 percent interest per annum. (2) In 1996, the mortgage company recorded the mortgage on the ranch. (3) In 2007, in a signed writing, which the borrower delivered to his daughter, the borrower promised to convey the ranch to the daughter by a quitclaim deed and pay the mortgage debt when it came due. (4) In 2008, the borrower delivered to the daughter a quitclaim deed that made no reference to the mortgage. If the borrower thereafter defaulted on the mortgage and the mortgage company brought an in personam action against the daughter to recover the amount due on the mortgage debt, the mortgagee will probably\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}