{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5ff09087-9dab-527b-b4dd-8cb4f3a524eb","task_key":"all--test--5ff09087-9dab-527b-b4dd-8cb4f3a524eb","task_revision_id":"1","upstream_id":"","short_description":"An owner of a solar heated residence filed a lawsuit that tried to enjoin her…","config":"all","split":"test","body":"{\"choices\":\"[\\\"Yes, because blocking a neighbor's sunlight is a constitutional deprivation of substantive due process.\\\", \\\"Yes, because the proposed use is a private nuisance that unreasonably interferes with the owner's use and enjoyment of her property.\\\", 'No, because the trial court was correct in ruling that there had to be some violation of building regulations before the construction could be enjoined.', \\\"No, because a comparative evaluation of the benefits and detriments of each position favor the neighbor's position.\\\"]\",\"question\":\"An owner of a solar heated residence filed a lawsuit that tried to enjoin her neighbor from building a house that would totally interfere with her access to daily sunlight. The neighbor's plan conformed to all local building ordinances and land use regulations. The owner had been in the house for 10 years and the neighbor recently bought the adjoining lot. The owner showed that a different placement of the house would not interfere with her use and enjoyment of her residence. The trial judge ruled in favor of the defendant on the basis that the defendant had a right to build his house anywhere as long as he followed the building/zoning laws. The owner appealed. Will the appellate court likely reverse the trial court's decision?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}