{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a364700b-2337-5304-a44f-effc53890db7","task_key":"all--test--a364700b-2337-5304-a44f-effc53890db7","task_revision_id":"1","upstream_id":"","short_description":"A cattle rancher owned substantial oil and mineral interests in the southwest.…","config":"all","split":"test","body":"{\"choices\":\"['the right to remove oil is an incident of a defeasible fee simple.', 'the personal assistant has no interest in the 200-acre tract.', 'there was no showing that the uncle acted in bad faith.', 'the right to remove oil is an incident of the right to possession.']\",\"question\":\"A cattle rancher owned substantial oil and mineral interests in the southwest. In July 1990, the rancher acquired title to a 200-acre tract in a rural area. In 1997, the rancher conveyed the 200-acre tract for a consideration of one dollar, receipt of which was acknowledged, \\\"to my uncle, his heirs, and assigns, but if my uncle's wife dies without issue, to my personal assistant and her heirs and assigns. \\\"After taking possession of the 200-acre tract, the uncle discovered considerable oil reserves on the property. He then began oil drilling operations and removed large quantities of oil, which he sold. At no time did he give notice to the personal assistant of his oil-drilling activities. Months passed before the personal assistant learned that the uncle was selling oil from the drilling operations. The personal assistant has now brought an action in equity for an accounting of the value of the oil removed and for an injunction against any further oil removal. If the decision is in favor of the uncle, it will be based on the fact that\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}