{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f66becaf-9c97-54f8-8e50-d2298e078314","task_key":"all--test--f66becaf-9c97-54f8-8e50-d2298e078314","task_revision_id":"1","upstream_id":"","short_description":"A farmer conveyed 100 acres of his farm to a landscaper. The deed contained the…","config":"all","split":"test","body":"{\"choices\":\"['the buyer, because the covenants contained inthe deed run with the land.', 'the farmer, because no privity of estate existsbetween the buyer and the farmer.', 'the buyer, but only for the covenants of seisinand right to convey.', 'the farmer, because the covenants are personalin nature and do not run with the land.']\",\"question\":\"A farmer conveyed 100 acres of his farm to a landscaper. The deed contained the following covenants: (1) seisin, (2) right to convey, and (3) against encumbrances. Subsequently, the landscaper conveyed the property to a buyer by warranty deed. However, the buyer is later evicted by a woman because of paramount title. The buyer now brings suit against the farmer for breach of covenants in the deed. Judgment should be for\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}