{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"800c7838-1de3-5a55-9e0f-321bf8404999","task_key":"all--test--800c7838-1de3-5a55-9e0f-321bf8404999","task_revision_id":"1","upstream_id":"","short_description":"A prominent judge lived next door to a father. Recently, the judge had sentenced…","config":"all","split":"test","body":"{\"choices\":\"['Negligence and battery.', 'Battery and assault.', 'Negligence and assault.', 'Battery and trespass to land.']\",\"question\":\"A prominent judge lived next door to a father. Recently, the judge had sentenced the father's son to six months in prison on a narcotics charge. One afternoon while the judge was mowing his lawn, the father decided to avenge his son's conviction. The father set up his water sprinkler behind some shrubbery separating their adjoining properties. As the judge was mowing his lawn and came within reach of the water sprinkler, the father turned on the sprinkling device. The judge did not see the water coming toward him. The water hit the judge in the back and drenched him. The judge would be able to recover against the father for which of the following tort or torts?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}