{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bd377fdc-28c8-5ccc-becd-37891de0ae53","task_key":"all--test--bd377fdc-28c8-5ccc-becd-37891de0ae53","task_revision_id":"1","upstream_id":"","short_description":"A shopkeeper is the owner of a vacant lot in fee simple absolute (the record…","config":"all","split":"test","body":"{\"choices\":\"['the friend only.', 'the friend, the son, and the daughter.', 'the friend, the son, the daughter, and any additional children of the sister born during her lifetime.', 'the friend, the son, the daughter, and any additional children of the sister born within 21 years after the death of the deceased son.']\",\"question\":\"A shopkeeper is the owner of a vacant lot in fee simple absolute (the record title is also in the shopkeeper). In 1960, the shopkeeper conveyed the property by general warranty deed as follows: \\\"The grantor hereby conveys the vacant lot to my friend, but if the property shall ever be used for church purposes, then to the children of my sister who reach the age of 25. \\\" At the time of the conveyance, the sister was single. Thereafter, the sister married and had two sons. Subsequently, one son died in an automobile accident. Three years after that son's death, the sister had a daughter. In an appropriate action to determine the ownership rights to the vacant lot with all minors represented, title is in\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}