{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"310d72f2-4f1e-5287-a262-da6ceef8e680","task_key":"default--test--1621","task_revision_id":"1","upstream_id":"1621","short_description":"A homeowner died in 1985. His will devised his estate in a southern state to his…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"[\\\"The uncle is entitled to a share of the profits from the best friend's crops, but not the rent paid by the teacher.\\\", 'The best friend is entitled to all profits and rents due to his continuous possession and maintenance of the estate.', \\\"The uncle is entitled to no share of any of the monies raised because the uncle's lack of contact with the best friend will be deemed a waiver.\\\", 'The uncle has forfeited all claims to the property and its profits due to his lack of interest and engagement.', \\\"The best friend is entitled to all monies raised due to his investment in the property, regardless of the uncle's claim.\\\", 'The uncle is entitled to all profits and rents due to his blood relation to the deceased homeowner.', 'As a cotenant in possession, the best friend retains the profits from his crops, and the uncle is entitled to a share of the rent paid by the teacher.', 'As a cotenant in possession, the best friend retains the profits from his crops and the rents paid by the teacher.', \\\"The uncle is entitled to a share of the rent that the teacher paid and the profits from the best friend's crops.\\\", 'The uncle and best friend must evenly split all profits and rents, regardless of who has been maintaining the property.']\",\"question\":\"A homeowner died in 1985. His will devised his estate in a southern state to his uncle and his best friend \\\"to share and share alike as tenants in common. \\\"At the time of the homeowner's death, the uncle lived in a different part of the southern state (in which the estate was located), while the best friend resided in a northern state. After the homeowner's funeral, the uncle returned to his own residence, but the best friend decided to occupy the estate. He put his name on the mailbox and has paid the taxes and maintenance expenses. To earn extra money, the best friend rented a small house on the property to a teacher and received a monthly rental payment from her. The best friend also grew fruits on the property and sold them at a stand on Fridays. The uncle has been generally aware of this, but because he cared little about the estate, the uncle has never pressed the best friend about the property. Since 1985 the uncle has not paid any rent or other compensation to the best friend, nor has the best friend requested such payment. In January 2010, a series of disputes arose between the uncle and the best friend for the first time concerning their respective rights to the estate. The state in which the property is located recognizes the usual common law types of cotenancies and follows majority rules on rents and profits. There is no applicable legislation on the subject. The uncle brings an appropriate action for a portion of the proceeds that the best friend received from his fruit stand and a portion of the rent that the teacher paid. If the best friend contests the apportionment of the monies he received, judgment should be for whom?\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}