{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2c3968c4-6957-5ffe-8464-74b49e05458c","task_key":"all--test--2c3968c4-6957-5ffe-8464-74b49e05458c","task_revision_id":"1","upstream_id":"","short_description":"A professor was the record owner in fee simple absolute of a 30-acre tract of…","config":"all","split":"test","body":"{\"choices\":\"['in the co-worker, with the entire interest subject to the mortgage.', 'in the co-worker, free and clear of the mortgage.', 'half in the co-worker and half in the uncle, with both subject to the mortgage.', 'half in the co-worker, free of the mortgage, and half in the uncle, subject to the mortgage.']\",\"question\":\"A professor was the record owner in fee simple absolute of a 30-acre tract of land located in a small town. The professor made a conveyance thereof in these words, \\\"I hereby convey my 30-acre tract to both my friend and my co-worker as joint tenants with right of survivorship. \\\"Two years after making the conveyance to the friend and the co-worker, the friend executed a mortgage on the 30-acre tract of land to a bank to secure a loan. One year after executing the mortgage, the friend died intestate, leaving his uncle as his only heir. At the time of the friend's death, the indebtedness had not been paid to the bank. The jurisdiction in which the 30-acre tract of land is located recognizes a title theory of mortgages. In an appropriate action, the court should determine that title to the 30-acre tract of land is vested\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}