{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"db052d58-9a79-5f79-877f-7cfe32e737a4","task_key":"default--test--1060","task_revision_id":"1","upstream_id":"1060","short_description":"Owner has a property in fee simple absolute. He executes a deed to Friend with…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['The doctrine of eminent domain', 'The rule of survivorship', 'The rule of destructibility of contingent remainders', \\\"The rule in Shelly's case\\\", 'The doctrine of escheat', 'The doctrine of concurrent ownership', 'The doctrine of worthier title', 'The rule of lapse', 'The rule against perpetuities', 'The doctrine of adverse possession']\",\"question\":\"Owner has a property in fee simple absolute. He executes a deed to Friend with the words \\\"To Friend for life and then to the heirs of Owner.\\\" Under common law principles the conveyance to the heirs is not effective. Thus, the deed would result in a life estate to Friend with a reversion back to Owner. That result is due to what common law doctrine?\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}