{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"53632f51-f116-588a-89a6-d2c364a5b974","task_key":"all--test--53632f51-f116-588a-89a6-d2c364a5b974","task_revision_id":"1","upstream_id":"","short_description":"A professor, being fee simple owner of an apartment building, made a conveyance…","config":"all","split":"test","body":"{\"choices\":\"['the daughter and the doctor as tenants in common.', \\\"the daughter subject to the professor's life estate.\\\", \\\"the daughter and the doctor as tenants in common, subject to the professor's life estate.\\\", \\\"the daughter and the doctor as joint tenants with survivorship rights, subject to the professor's life estate.\\\"]\",\"question\":\"A professor, being fee simple owner of an apartment building, made a conveyance thereof in these words, \\\"I hereby convey my apartment building to my son and daughter as tenants in common. \\\" In the deed instrument, which was properly executed, the professor reserved a life estate to himself. The professor then told his children of his conveyance and put it in the family vault in the library for safekeeping. Thereafter, the son married a doctor. The professor, who disliked the doctor, then executed another deed that he labeled \\\"a correction deed. \\\" In the \\\"correction deed,\\\" the professor conveyed the apartment building \\\"to my son and daughter as joint tenants with right of survivorship. \\\" According to the new deed, the professor again reserved a life estate to himself. Both children accepted delivery of the \\\"correction deed. \\\" Six months later, the son died intestate, leaving the doctor as his sole heir. Title to the apartment building is in\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}