{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6dc7c967-be37-55d6-ba5b-5c072a122145","task_key":"default--test--1266","task_revision_id":"1","upstream_id":"1266","short_description":"A landowner, her aunt, and her brother are the owners of three contiguous lots.…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"[\\\"not enjoin the aunt's experiments because the brother does not own the space above his land.\\\", \\\"enjoin the aunt's experiments because they can potentially cause harm to the brother's ham radio operations.\\\", \\\"enjoin the aunt's experiments because they constitute an unreasonable interference with the space above the brother's land.\\\", \\\"enjoin the aunt's experiments because one does not have the right to engage in such scientific experiment without permission.\\\", \\\"enjoin the aunt's experiments because the brother has a right to quiet enjoyment of his property.\\\", \\\"not enjoin the aunt's experiments if they do not physically damage the brother's property.\\\", \\\"not enjoin the aunt's experiments because they contribute to scientific research and discovery.\\\", \\\"enjoin the aunt's experiments because she did not have proper permits for scientific experimentation.\\\", \\\"not enjoin the aunt's lightning rod experiments if they were necessary to protect her property from the electrical storms.\\\", \\\"not enjoin the aunt's experiments because the electrical storms are natural occurrences that she cannot control.\\\"]\",\"question\":\"A landowner, her aunt, and her brother are the owners of three contiguous lots. A downward slope exists from the landowner's land to the brother'sland. The aunt, the owner in the middle of the three lots, was an amateur scientist. She began experimentation with electricity, using a lightning rod to conduct her experiments. Frequently, the electrical storms apparently originated in and over the area within which the brother's land is located. Because of this, the aunt would often angle her rod over the fence between her property and the brother's property to maximize her chances of success. After one entire rainy and windy season of experiments, the brother had grown tired of the aunt's lightning-rod intrusions because they interfered with his ham radio operations in his garage. The brother brought suit to enjoin such lightning-rod experiments. At trial, it was found that the aunt had been conducting her activities in the airspace directly above the brother's land. The court should\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}