{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b866f6c6-47e3-5d3a-ae92-47312c28b414","task_key":"all--test--b866f6c6-47e3-5d3a-ae92-47312c28b414","task_revision_id":"1","upstream_id":"","short_description":"On February 1, a woman conveys her farm to a man, and the man duly records the…","config":"all","split":"test","body":"{\"choices\":\"['The farmer.', 'The sister.', 'The friend.', 'The man.']\",\"question\":\"On February 1, a woman conveys her farm to a man, and the man duly records the conveyance. The following day, the man conveys the property to his sister; she does not record her deed. Then on February 4, the man executes an identical conveyance of the farm to a friend. The friend gives the man a check for $100,000 for the property and records the conveyance, even though he has actual knowledge of the prior conveyance to the sister. The sister, however, records her deed on February 6. The friend then conveys his interest in the farm to a farmer, who gives a purchase price of $115,000 to the friend. On February 5, the farmer purchases the farm without notice of the conveyance to the sister and duly records the deed. If the property in question was located in a state having a notice-type statute, which of the following parties would ultimately prevail?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}