{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5f12bd3f-4efc-523b-8255-37ccaab2472b","task_key":"default--test--1642","task_revision_id":"1","upstream_id":"1642","short_description":"A homeowner conveyed his property to his cousin \"for life, with remainder to…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['Doctrine of Lapse.', 'Doctrine of Life Estate Pur Autre Vie.', 'Doctrine of Worthier Title.', \\\"Rule in Shelley's Case.\\\", 'Doctrine of Destructibility of Contingent Remainders.', 'Rule against Perpetuities.', 'Doctrine of Merger.', \\\"Rule in Wild's Case.\\\", \\\"Rule against Remainders in the Grantees' Heirs.\\\", 'Doctrine of Adverse Possession.']\",\"question\":\"A homeowner conveyed his property to his cousin \\\"for life, with remainder to (the homeowner's) heirs. \\\" Later, the cousin conveyed the property to a farmer \\\"for as long as he would continue to farm the property. \\\" After the cousin's death, the homeowner's heirs brought suit against the farmer to quiet title. Which common law doctrine would be most applicable in the court's determination of the ownership of the property?\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}