{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d57b9e28-f691-5b66-8ee9-94db2db3df1b","task_key":"all--test--d57b9e28-f691-5b66-8ee9-94db2db3df1b","task_revision_id":"1","upstream_id":"","short_description":"Owner has a property in fee simple absolute. He executes a deed to Friend with…","config":"all","split":"test","body":"{\"choices\":\"[\\\"The rule in Shelly's case\\\", 'The doctrine of concurrent ownership', 'The doctrine of worthier title', 'The rule against perpetuities']\",\"question\":\"Owner has a property in fee simple absolute. He executes a deed to Friend with the words \\\"To Friend for life and then to the heirs of Owner.\\\" Under common law principles the conveyance to the heirs is not effective. Thus, the deed would result in a life estate to Friend with a reversion back to Owner. That result is due to what common law doctrine?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}