{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2f5a96f9-4407-5d24-b834-cbbfd34cb8ac","task_key":"all--test--2f5a96f9-4407-5d24-b834-cbbfd34cb8ac","task_revision_id":"1","upstream_id":"","short_description":"A woman acquired land by a deed that contained the following language in the…","config":"all","split":"test","body":"{\"choices\":\"['The investor, because the woman cannot sell the land during the 10-year period specified in the deed.', \\\"The investor, because the woman's heirs did not join in the contract.\\\", 'The woman, because the contract did not obligate her to provide marketable title.', \\\"The woman, because the deed's restraint on transfer is void as a matter of law.\\\"]\",\"question\":\"A woman acquired land by a deed that contained the following language in the grantee section: \\\"to [the woman], her heirs and assigns, provided, however, that said grantee may not transfer any interest in the land for 10 years from the date of this instrument.\\\" Two years later, the woman contracted to sell the land to an investor for a price based on a recent appraisal. When the investor's title search revealed the above language in the grantee section of the deed to the woman, the investor refused to close the transaction. The contract was silent as to the woman's title obligation. The woman has sued the investor for specific performance. Who is likely to prevail?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}