{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2ca4e4ed-995a-5e81-a17f-50caafc95ef1","task_key":"default--test--1344","task_revision_id":"1","upstream_id":"1344","short_description":"A homeowner buys a new leaf blower and is so impressed with its power that he…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"[\\\"Yes, because the homeowner expected the wind to carry the debris away and did not think that it would accumulate on the neighbor's property.\\\", \\\"No, because the homeowner's actions resulted in a direct invasion of the neighbor's property.\\\", \\\"Yes, because the debris was not intentionally directed at the neighbor's property.\\\", 'Yes, because the homeowner was not aware of the pest-infested debris.', 'No, because the neighbor was able to prove financial loss from the damage caused.', 'No, because trespass is based on an intentional act of entering the land or sending something onto the land, and the actor does not have to intend harm to be liable for the tort.', 'Yes, because the homeowner had no practical way of controlling where the material went and he acted without malice or ill will.', \\\"Yes, because the homeowner did not physically enter the neighbor's property.\\\", 'No, because the infected debris constituted an abnormally dangerous condition and homeowner could be held strictly liable for the trespass.', \\\"No, because the act of blowing debris onto the neighbor's land constitutes a trespass regardless of intent.\\\"]\",\"question\":\"A homeowner buys a new leaf blower and is so impressed with its power that he gets carried away and blows large amounts of his work onto the next door neighbor's yard. In addition to leaves, he also blew large amounts of pest-infested plant debris onto the neighbor's property. The material has accumulated into large, unsightly piles and caused damage to the neighbor's healthy plants. He has to pay workers to haul the material away and he incurs expenses to replace infected perennials. The neighbor sues for the tort of trespass. The homeowner files a motion to dismiss because the neighbor cannot prove that homeowner acted with an intent to trespass or to do harm. Will the court grant the motion to dismiss?\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}