{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"81529f5d-d48f-5e0e-b3a2-ef58abca1794","task_key":"all--test--81529f5d-d48f-5e0e-b3a2-ef58abca1794","task_revision_id":"1","upstream_id":"","short_description":"A landowner, her aunt, and her brother are the owners of three contiguous lots.…","config":"all","split":"test","body":"{\"choices\":\"[\\\"enjoin the aunt's experiments because they constitute an unreasonable interference with the space above the brother's land.\\\", \\\"enjoin the aunt's experiments because one does not have the right to engage in such scientific experiment without permission.\\\", \\\"not enjoin the aunt's lightning rod experiments if they were necessary to protect her property from the electrical storms.\\\", \\\"not enjoin the aunt's experiments because the brother does not own the space above his land.\\\"]\",\"question\":\"A landowner, her aunt, and her brother are the owners of three contiguous lots. A downward slope exists from the landowner's land to the brother'sland. The aunt, the owner in the middle of the three lots, was an amateur scientist. She began experimentation with electricity, using a lightning rod to conduct her experiments. Frequently, the electrical storms apparently originated in and over the area within which the brother's land is located. Because of this, the aunt would often angle her rod over the fence between her property and the brother's property to maximize her chances of success. After one entire rainy and windy season of experiments, the brother had grown tired of the aunt's lightning-rod intrusions because they interfered with his ham radio operations in his garage. The brother brought suit to enjoin such lightning-rod experiments. At trial, it was found that the aunt had been conducting her activities in the airspace directly above the brother's land. The court should\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}