{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fc4eb859-e569-5141-8466-7e1ce44aba97","task_key":"all--test--fc4eb859-e569-5141-8466-7e1ce44aba97","task_revision_id":"1","upstream_id":"","short_description":"A homeowner buys a new leaf blower and is so impressed with its power that he…","config":"all","split":"test","body":"{\"choices\":\"['No, because the infected debris constituted an abnormally dangerous condition and homeowner could be held strictly liable for the trespass.', 'No, because trespass is based on an intentional act of entering the land or sending something onto the land, and the actor does not have to intend harm to be liable for the tort.', 'Yes, because the homeowner had no practical way of controlling where the material went and he acted without malice or ill will.', \\\"Yes, because the homeowner expected the wind to carry the debris away and did not think that it would accumulate on the neighbor's property.\\\"]\",\"question\":\"A homeowner buys a new leaf blower and is so impressed with its power that he gets carried away and blows large amounts of his work onto the next door neighbor's yard. In addition to leaves, he also blew large amounts of pest-infested plant debris onto the neighbor's property. The material has accumulated into large, unsightly piles and caused damage to the neighbor's healthy plants. He has to pay workers to haul the material away and he incurs expenses to replace infected perennials. The neighbor sues for the tort of trespass. The homeowner files a motion to dismiss because the neighbor cannot prove that homeowner acted with an intent to trespass or to do harm. Will the court grant the motion to dismiss?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}