{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"73d4a4de-a5e7-5c47-b1fc-18f4d63df4a1","task_key":"all--test--73d4a4de-a5e7-5c47-b1fc-18f4d63df4a1","task_revision_id":"1","upstream_id":"","short_description":"Landowner's property was landlocked. He had to go to court to ask the court to…","config":"all","split":"test","body":"{\"choices\":\"['The holder of the easement has a right to insist on its uninterrupted continuance.', 'The easement continues because its purpose of access to the property still exists.', 'The easement is terminated because it cannot exceed five years in length, without being formally renewed by both parties.', 'The equities favor the termination of the easement where another route is available.']\",\"question\":\"Landowner's property was landlocked. He had to go to court to ask the court to compel the adjacent landowner to give him an easement of necessity for ingress and egress to the highway. The court granted the easement of necessity to Landowner. Over a decade later, another access route to the highway opened up through public improvements. The adjacent landowner sued to stop Landowner from continuing to use his land for ingress and egress. What will the court most likely rule in this case?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}