{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b9f1ca45-286f-551d-b9ab-71b58ffd5696","task_key":"default--test--1796","task_revision_id":"1","upstream_id":"1796","short_description":"A veterinarian was the owner in fee of a 50-acre tract of farmland. The…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['the recording statute does not apply to this situation since the investor was already making payments.', 'the investor was aware of the mortgage when he signed the contract.', \\\"the prior mortgage has no legal effect on the investor's rights under the installment land-sale agreement.\\\", 'the investor did not properly inspect the property before purchase.', 'the time for the veterinarian, as seller, to deliver marketable title has not yet arrived.', \\\"although the land-sale agreement is actually a mortgage, it does not impair the investor's right of redemption.\\\", \\\"the veterinarian is not in default of her mortgage payments, thus not affecting the investor's rights.\\\", 'the investor has failed to fulfill his part of the contract by discontinuing the installment payments.', 'the veterinarian offered a warranty deed to the investor, securing his rights.', 'the installment land-sale agreement is a security device.']\",\"question\":\"A veterinarian was the owner in fee of a 50-acre tract of farmland. The veterinarian contracted to sell her property to an investor for $300,000. The parties signed a written land-sale agreement that provided for 30 monthly installment payments of $10,000 each. According to the terms of the sale agreement, the veterinarian would deliver a warranty deed to the investor upon payment of the last installment. In accordance with state law, the farmland's land-sale agreement was properly recorded. After making the first 10 installment payments, the investor discovered that there was an unrecorded mortgage on the farmland. The veterinarian, who is the mortgagor, has regularly made her mortgage payments and is not in default. This jurisdiction has the following recording statute in effect:\\\"No conveyance or instrument is good as against any subsequent purchaser for value and without notice, unless the same be recorded prior to subsequent purchase. \\\"After the investor learned of the outstanding mortgage, he discontinued making further installment payments to the veterinarian. The investor alleged that the veterinarian was in breach of the land-sale agreement due to the existence of the unrecorded mortgage. The investor sues the veterinarian for breach of contract. Ifjudgment is rendered in favor of the veterinarian, it will be because\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}