{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"73073d72-4290-5dce-b029-94e99d8f41bb","task_key":"all--test--73073d72-4290-5dce-b029-94e99d8f41bb","task_revision_id":"1","upstream_id":"","short_description":"A landowner sold and conveyed a parcel of land to the buyer by a deed containing…","config":"all","split":"test","body":"{\"choices\":\"['No, the court will confine itself to what is in the four corners of the deed.', 'No, because that would violate the parole evidence rule.', \\\"Yes, because the court always has a right to reform the wording of a deed according to the court's interpretation of what it means.\\\", 'Yes, because an ambiguously-worded easement or right-of-way can be supplemented by outside information to get at the true intention of the parties.']\",\"question\":\"A landowner sold and conveyed a parcel of land to the buyer by a deed containing this clause: \\\"Less and excepting a strip of land forty feet wide along the east side of Winter Street, all the way across said land, for use in the future if and when a road is needed for travel. \\\" They had signed a side agreement during negotiations saying that the landowner-seller would retain an absolute right to travel over that strip of land for certain purposes. The buyer later stopped the seller from continuing to use the strip for travel because no road had been constructed. The landowner sued the buyer, claiming that he still owned the forty-foot strip of land because it was not conveyed in the deed and was at best ambiguously stated. Will the court consider the outside evidence that the parties intended this to be a right-of-way over the buyer's land?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}