{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"41d1ac0c-1f4b-59a4-a54c-0cccf7d28225","task_key":"default--test--1533","task_revision_id":"1","upstream_id":"1533","short_description":"A man conveyed land by quitclaim deed as a gift to his cousin, who did not then…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['For the friend, because the cousin did not take possession of the land.', 'For the friend, because the cousin did not record her deed in time.', 'For the cousin, because she has the original deed.', 'For the friend, because a subsequent good- faith donee has priority over a prior donee who fails to record.', 'For the cousin, because the friend failed to first record.', 'For the cousin, because the friend did not pay for the land.', 'For the cousin, because the man had already given the land away before giving it to the friend.', 'For the friend, because he was first in possession.', 'For the friend, because he was not aware of the previous deed.', 'For the cousin, because she was first in time and the friend was not a purchaser.']\",\"question\":\"A man conveyed land by quitclaim deed as a gift to his cousin, who did not then record the deed or take possession of the land. Six months later, when the man was still in possession, he conveyed the land by quitclaim deed as a gift to a friend, who knew nothing of the deed to the cousin. The friend did not record his deed. The man then vacated the land, and the friend took possession. The recording act of the jurisdiction provides as follows: \\\"No unrecorded conveyance or mortgage of real property shall be good against subsequent purchasers for value without notice, who shall first record.\\\" Recently, the cousin learned about the friend's deed and possession, immediately recorded her deed, and sued the friend for possession and to quiet title. The friend then recorded his deed and raised all available defenses. For whom is the court likely to decide?\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}