{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b0950ba7-a278-5dd3-9cae-e41f1c704cec","task_key":"default--test--1189","task_revision_id":"1","upstream_id":"1189","short_description":"A grantor conveyed her mansion and surrounding property to her nephew \"for life,…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"[\\\"denied, because the remainder to the nephew's heirs is a contingent interest.\\\", 'granted, because the nephew has the right to sell his life estate.', 'denied, because the nephew cannot convey a larger estate than he possesses.', \\\"denied, because the nephew's interest is limited to his lifetime and he cannot transfer a fee simple absolute.\\\", 'denied, because the Rule would not be triggered, thus creating only a life estate in the nephew.', \\\"granted, because the nephew's life estate combined with his vested remainder gives him a fee simple.\\\", \\\"denied, because under the Doctrine of Worthier Title, at the termination of the nephew's life estate, the grantor has a reversionary interest.\\\", \\\"granted, because the nephew's heirs receive a vested indefeasible interest in the property.\\\", 'granted, because the nephew has a vested remainder in fee simple absolute.', 'granted, because the remainder in his heirs would become vested into a full fee in those heirs.']\",\"question\":\"A grantor conveyed her mansion and surrounding property to her nephew \\\"for life, remainder after (the nephew's) death to his heirs. \\\" Two years later, the nephew entered into a real estate agreement for the sale of the property to his brother, whereby the nephew agreed to convey the premises to the brother in fee simple absolute. Prior to the settlement date, the brother contacted the nephew, telling him that he would not perform his part of the agreement because the nephew could not convey a fee simple. The Rule in Shelley's Case has been abolished by statute in this jurisdiction. Thus, the nephew's prayer for specific performance would be\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}