{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3b19929a-76c7-5c53-b919-a48c8dc8c2ec","task_key":"all--test--3b19929a-76c7-5c53-b919-a48c8dc8c2ec","task_revision_id":"1","upstream_id":"","short_description":"A grantor conveyed her mansion and surrounding property to her nephew \"for life,…","config":"all","split":"test","body":"{\"choices\":\"['denied, because the Rule would not be triggered, thus creating only a life estate in the nephew.', 'granted, because the remainder in his heirs would become vested into a full fee in those heirs.', \\\"granted, because the nephew's heirs receive a vested indefeasible interest in the property.\\\", \\\"denied, because under the Doctrine of Worthier Title, at the termination of the nephew's life estate, the grantor has a reversionary interest.\\\"]\",\"question\":\"A grantor conveyed her mansion and surrounding property to her nephew \\\"for life, remainder after (the nephew's) death to his heirs. \\\" Two years later, the nephew entered into a real estate agreement for the sale of the property to his brother, whereby the nephew agreed to convey the premises to the brother in fee simple absolute. Prior to the settlement date, the brother contacted the nephew, telling him that he would not perform his part of the agreement because the nephew could not convey a fee simple. The Rule in Shelley's Case has been abolished by statute in this jurisdiction. Thus, the nephew's prayer for specific performance would be\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}