{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"11e76cfe-f52a-53db-8890-21ee01f95ade","task_key":"all--test--11e76cfe-f52a-53db-8890-21ee01f95ade","task_revision_id":"1","upstream_id":"","short_description":"An environmentalist was very interested in environmental issues, particularly…","config":"all","split":"test","body":"{\"choices\":\"['that he had sound environmental reasons for maintaining the swampy condition of his yard.', 'that turning his yard into a swampy marsh did not violate any zoning ordinance.', 'that the investor owns the property but has rented it out, so the investor does not have actual possession or the right to immediate possession of the land.', \\\"that when the investor purchased the house, he knew or should have known about the swampy condition of the environmentalist's property.\\\"]\",\"question\":\"An environmentalist was very interested in environmental issues, particularly protection of wetland areas. He decided to dig out the lawn in his back yard and turn the space into a swampy marsh. Eventually, his back yard was filled with tall grasses, reeds, and other marsh plants. A wide variety of frogs, turtles, snakes, birds, and other animals inhabited the yard. The ground was usually covered by several inches of standing water. The environmentalist's neighbors were not pleased with the condition of the environmentalist's yard. They complained that it produced foul odors, and they claimed that the standing water was a breeding ground for mosquitoes and other insects. Several months after the environmentalist converted his yard into a marsh, a real estate investor purchased the house closest to the environmentalist's back yard swamp. The investor lived in a large city several hundred miles away, and he purchased the house next to the environmentalist's for investment purposes. The investor rented the house to a family under a long-term lease. The tenant family complained frequently to the investor about being annoyed by the environmentalist's yard. If the investor asserts a nuisance claim against the environmentalist, the environmentalist's best defense would be\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}