{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"62c23938-2d73-53dd-9595-cd6d1738ab18","task_key":"all--test--62c23938-2d73-53dd-9595-cd6d1738ab18","task_revision_id":"1","upstream_id":"","short_description":"A retiree lived in a single-family dwelling in the city. Adjacent to his home…","config":"all","split":"test","body":"{\"choices\":\"[\\\"The retiree's heirs will prevail because metes and bounds, rather than streets, are appropriate boundary descriptions.\\\", 'The friend will prevail because equity will not permit forfeiture for a mere technicality.', 'The outcome will depend on whether the tract of land was plotted as a lot in a subdivision.', 'The outcome will depend on whether the last call (175 feet along University Way) prevails over the third call (west 100 feet).']\",\"question\":\"A retiree lived in a single-family dwelling in the city. Adjacent to his home was a vacant lot that measured 100 feet by 175 feet. The lot, which the retiree owned, was situated on the corner of Davis Street and University Way. The tract measured 100 feet along Davis Street and 175 feet along University Way. The retiree executed a deed purporting to convey the vacant lot to his lifelong friend for the consideration of $28,000. After escrow, the deed was delivered to the friend, who immediately filed it with the county recorder's office. The recorded instrument described the property conveyed as \\\"all the tract of land beginning at the northwest corner of Davis Street and University Way; thence west along Davis Street 100 feet; thence north 175 feet; thence west 100 feet; thence south 175 feet along University Way to the place of beginning. \\\" Three months after his conveyance to the friend, the retiree died intestate. His heirs have now filed an appropriate action contesting the friend's title to the vacant lot. Which of the following statements is most accurate concerning the outcome of this suit?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}