{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"18af7fe6-95ce-5846-865c-ce3adda8fae7","task_key":"all--test--18af7fe6-95ce-5846-865c-ce3adda8fae7","task_revision_id":"1","upstream_id":"","short_description":"An uncle owns his property in fee simple. The uncle executes and delivers a deed…","config":"all","split":"test","body":"{\"choices\":\"['The nephew and niece are joint tenants in fee simple defeasible, and the gardener has an executory interest.', 'The nephew has a life estate, the niece has a life estate pur autre vie, and the gardener has a vested remainder.', 'The nephew and niece are tenants in common for the life of the first of them to die, the nephew and niece have contingent remainders in fee simple defeasible, and the gardener has an executory interest.', 'The nephew has a life estate, the niece also has a life estate, and the gardener has a vested remainder.']\",\"question\":\"An uncle owns his property in fee simple. The uncle executes and delivers a deed to the property with the following granting clause:\\\"To my nephew and my niece for the life of my nephew, then to my gardener. \\\"As a result of the grant, which of the following is the most accurate statement regarding the ownership rights of the property?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}