{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"461662fb-e870-5a4e-9994-5d7ffaedda1d","task_key":"all--test--461662fb-e870-5a4e-9994-5d7ffaedda1d","task_revision_id":"1","upstream_id":"","short_description":"A man conveyed the eastern half of a tract of vacant land to a woman by a…","config":"all","split":"test","body":"{\"choices\":\"['The cousin, based on necessity.', \\\"The cousin, because the woman's land is still vacant.\\\", 'The woman, because the cousin could obtain an alternative access to the highway from the neighbor.', 'The woman, because the man failed to reserve an easement in his deed to the woman.']\",\"question\":\"A man conveyed the eastern half of a tract of vacant land to a woman by a warranty deed. The woman promptly recorded the deed. The land conveyed to the woman fronted on a public highway. The land retained by the man was landlocked. One year later, the man died intestate, leaving a cousin as his only heir. The cousin visited the man's land for the first time and discovered that it had no access to a public highway. A neighbor who owned adjoining land fronting on the public highway offered to sell the cousin a right to cross the neighbor's land for access to the highway. Although the neighbor's price was reasonable, the cousin rejected the offer. The woman has refused to allow the cousin to cross her land for access to the public highway even though the woman's land is still vacant. The cousin has sued the woman, seeking access across the woman's land to the public highway. Who is likely to prevail?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}