{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c5b981a5-d198-5bed-a359-7e7636695b90","task_key":"default--test--1843","task_revision_id":"1","upstream_id":"1843","short_description":"A prominent judge lived next door to a father. Recently, the judge had sentenced…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['Trespass to land and intentional infliction of emotional distress.', 'Assault and intentional infliction of emotional distress.', 'Negligence and intentional infliction of emotional distress.', 'Trespass to chattels and battery.', 'Negligence and battery.', 'Assault and trespass to chattels.', 'Battery and trespass to land.', 'Negligence and assault.', 'Battery, assault and trespass to land.']\",\"question\":\"A prominent judge lived next door to a father. Recently, the judge had sentenced the father's son to six months in prison on a narcotics charge. One afternoon while the judge was mowing his lawn, the father decided to avenge his son's conviction. The father set up his water sprinkler behind some shrubbery separating their adjoining properties. As the judge was mowing his lawn and came within reach of the water sprinkler, the father turned on the sprinkling device. The judge did not see the water coming toward him. The water hit the judge in the back and drenched him. The judge would be able to recover against the father for which of the following tort or torts?\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}