{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f08b01ba-37ae-5974-9e58-bd76ca0d2a68","task_key":"all--test--f08b01ba-37ae-5974-9e58-bd76ca0d2a68","task_revision_id":"1","upstream_id":"","short_description":"A widow was the owner in fee simple of an apartment building. The widow drafted…","config":"all","split":"test","body":"{\"choices\":\"[\\\"Yes, because under the anti-lapse statute, the granddaughter's interest passes to her son.\\\", 'Yes, because rules relating to lapse of class gifts do not apply to specific devises.', 'No, because intestate succession is inapplicable to devolution of title to specific devisees.', 'No, because the granddaughter predeceased the widow, title to the apartment building passes to the friend and assistant under the residuary clause of the will.']\",\"question\":\"A widow was the owner in fee simple of an apartment building. The widow drafted a will by which she devised the apartment building to her granddaughter with residue to her friend and her assistant. One year later, the granddaughter died intestate and was survived by her son who was her sole heir at law. This jurisdiction has the following statute in effect:\\\"If a devisee of a grandparent or lineal descendant of a grandparent dies at the time of execution of the will or fails to survive the testator, the issue of the deceased person shall take the decedent's share under the will. \\\"The widow then died and her will was admitted to probate. A dispute arose among the friend, the assistant, and the son regarding ownership of the apartment building. Is the son entitled to any share or interest in the apartment building?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}