{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8fd1e978-d1fb-5ea6-bc4d-ee5cc4dc763a","task_key":"all--test--8fd1e978-d1fb-5ea6-bc4d-ee5cc4dc763a","task_revision_id":"1","upstream_id":"","short_description":"A lady owns a house in fee simple absolute, which she devises to her cousin, in…","config":"all","split":"test","body":"{\"choices\":\"[\\\"Yes, because of the rule in Shelly's case.\\\", \\\"No, because when property is put in a trust through a donee's special power of appointment, creditors cannot reach the funds.\\\", 'Yes, because the will is invalidated by the rule of sequential appointments, and the grandchild does not take at all.', 'No, because the will as written violates the rule against perpetuities, and reconstructed, the funds revert to the original owner or her heirs.v']\",\"question\":\"A lady owns a house in fee simple absolute, which she devises to her cousin, in trust for her grandchild, for her grandchild's life, and then to the children appointed in a will by her grandchild. If there is no such appointment in a will, in equal shares to any surviving children of her grandchild. When the grandchild dies, she is in debt. Can the creditors attach the house?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}