{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d7414c6e-cd51-57b2-9bf3-a61be7952f18","task_key":"all--test--d7414c6e-cd51-57b2-9bf3-a61be7952f18","task_revision_id":"1","upstream_id":"","short_description":"A widower was the owner in fee of a 10-acre quarry. On August 1, the widower…","config":"all","split":"test","body":"{\"choices\":\"['There was an effective \\\"causa mortis\\\" gift.', 'The delivery was effective when the widower handed the deed to the friend.', 'The delivery was effective when the friend recorded the deed.', 'The deed was recorded before the devise was effectuated.']\",\"question\":\"A widower was the owner in fee of a 10-acre quarry. On August 1, the widower handed his friend a deed conveying the quarry to his niece and said to the friend, \\\"Give this to my niece. \\\" Unknown to the widower, the niece was in Africa. The next week, the friend properly recorded the deed with the Recorder's Office. One month later, the widower died, and in his will he devised the quarry to his daughter. Thereafter, the niece returned from Africa, and a dispute arose between the niece and the daughter regarding ownership of the quarry. In a suit to quiet title to the quarry, the court ruled in favor of the niece. The ruling was most likely based upon which of the following?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}