{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4c8de9be-24c6-5473-902e-b5f564c7f224","task_key":"all--test--4c8de9be-24c6-5473-902e-b5f564c7f224","task_revision_id":"1","upstream_id":"","short_description":"A man and his neighbor owned homes on adjacent lots in a subdivision. The…","config":"all","split":"test","body":"{\"choices\":\"['No, because several homeowners in the subdivision have storage sheds in their yards.', 'No, because there was no horizontal privity between the man and the neighbor.', 'Yes, because the neighbor conveyed the home to the daughter by gift rather than by sale.', 'Yes, because the restriction is binding on the daughter as a successor.']\",\"question\":\"A man and his neighbor owned homes on adjacent lots in a subdivision. The subdivision's recorded restrictions did not prohibit detached storage sheds, and several homeowners in the subdivision had placed such sheds in their backyards. Because the man and the neighbor thought the sheds were unsightly, they both agreed in writing not to place detached storage sheds in their respective yards. Their agreement was drafted in recordable form and stated that it was enforceable by and against all assignees, heirs, and successors. The agreement was assignees, heirs, and successors. The agreement was promptly recorded. Three years later, the neighbor gave his home to his daughter. Shortly after moving into the home, the daughter learned of the restriction. She informed the man that she planned to put a detached storage shed in her backyard, claiming that the restriction was not enforceable against her. Does the man have the right to enjoin the neighbor's daughter from placing a detached storage shed in her yard?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}