{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"aeac797c-9fe7-584b-9c75-504a234e9407","task_key":"all--test--aeac797c-9fe7-584b-9c75-504a234e9407","task_revision_id":"1","upstream_id":"","short_description":"A rancher is currently the owner of record of a parcel of land designated as \"A.…","config":"all","split":"test","body":"{\"choices\":\"[\\\"the rancher, because the deed to the farmer did not contain any covenants restricting the rancher's use of the land.\\\", \\\"the rancher, because the farmer's proper cause of action would be for nuisance, rather than trespass.\\\", \\\"the farmer, because the drainage system was the proximate cause of the plaintiff's damages as a matter of law.\\\", 'the farmer, because the rancher did not have the right to improve his own land in a manner that caused harm to another.']\",\"question\":\"A rancher is currently the owner of record of a parcel of land designated as \\\"A. \\\" It is the higher of two neighboring properties on a mountain. A farmer is the owner of parcel \\\"B,\\\" which is situated lower than \\\"A\\\" on the mountainside. In 2000, the rancher, who owned both parcels of land, constructed a private drainage system. This system consisted of an underground pipeline that extended across both parcels of land. Sewage from parcel \\\"A\\\" drained through the system to a municipal sewer, which was located at the bottom of the mountain. In 2005, the rancher sold parcel \\\"B\\\" to the farmer. The deed to the farmer did not contain any mention of the rancher's drainage system. Located on each of the parcels are large ranch-style homes occupied by the respective owners. Lately, the sewage drain has begun to emit an unpleasant odor across parcel \\\"B. \\\" As a result, the farmer sued the rancher in trespass praying for damages caused by the drainage system. Judgment should be for\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}