{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2668806f-24d8-5533-84e0-db7db6109e9d","task_key":"all--test--2668806f-24d8-5533-84e0-db7db6109e9d","task_revision_id":"1","upstream_id":"","short_description":"A man is the owner of record of a parcel of land designated as \"A. \" It is the…","config":"all","split":"test","body":"{\"choices\":\"['easement appurtenant.', 'easement by implication.', 'prescriptive easement.', 'express easement.']\",\"question\":\"A man is the owner of record of a parcel of land designated as \\\"A. \\\" It is the highest of three neighboring properties on a mountain. The man's friend is the owner of parcel \\\"B,\\\" which is situated lower than \\\"A\\\" on the mountainside. The man's cousin owns parcel \\\"C,\\\" which lies below parcels \\\"A\\\" and \\\"B\\\" on the mountain slope. In 2000, the man who originally owned all three parcels of land constructed a private drainage system. This system consisted of an underground pipeline that extended across all three parcels of land. Sewage from parcel \\\"A\\\" drained through the system to a municipal sewer, which was located at the bottom of the mountain. In 2005, the man sold parcel \\\"B\\\" to his friend. The following year, the cousin purchased parcel \\\"C\\\" from the man. The deeds to the friend and the cousin did not contain any mention of the man's drainage system. Located on each of the parcels are large ranch-style homes occupied by the respective owners. From the standpoint of the friend and the cousin, thedrainage system would most likely be defined as a(an)\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}