{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f2c0fe36-a35b-55a4-a2f4-70f1437bd723","task_key":"all--test--f2c0fe36-a35b-55a4-a2f4-70f1437bd723","task_revision_id":"1","upstream_id":"","short_description":"A partnership conveyed a general warranty deed representing a vacant parcel of…","config":"all","split":"test","body":"{\"choices\":\"['Yes, this is a covenant running with the land because it was intended to apply to the first purchaser\\\\'s heirs and \\\"assigns\\\".', 'Yes, because a landowner is in any event responsible for her share of improvements to any abutting private roads.', 'No, because the general warranty of the original sellers did not apply beyond the first purchaser.', 'No, because the paving requirement had to be placed in the deed to the married couple and it was not.']\",\"question\":\"A partnership conveyed a general warranty deed representing a vacant parcel of land to the purchaser. In the deed, the grantee and her assigns were required by covenant to share proportionately in the paving of a road that abutted the property. The grantee conveyed the property to a married couple by special warranty deed that did not contain any of the conditions of the covenant regarding paving the new road. The buyers did not have an attorney and did not do a title search. When the road was completed, the married couple buyers refused to pay the share that was demanded of them. The original sellers of the parcel sued the couple in an equity claim without a jury. The judge ruled that the couple had to pay their share of the paving. On appeal, will the appellate court affirm the trial judge's order?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}