{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e5593aa0-0650-52f9-a5c8-e9db7d2c9364","task_key":"all--test--e5593aa0-0650-52f9-a5c8-e9db7d2c9364","task_revision_id":"1","upstream_id":"","short_description":"Two brothers owned a parcel of real estate as joint tenants. Both brothers…","config":"all","split":"test","body":"{\"choices\":\"['No, the deed cannot bind partner one because he did not participate in the deed delivery to the buyer and did not intend to deliver the deed up to the grantee at that time.', \\\"Yes, the transfer is valid from both partners because partner two was partner one's apparent agent for purposes of delivering the deed.\\\", 'Yes, the deed was signed by both partners, which proved their intent to sell to buyer, and it was delivered at the time of signing by the fact of affixing their signatures to the document.', 'No, the deed was invalid as to both grantors because partner two stepped outside his scope of authority.']\",\"question\":\"Two brothers owned a parcel of real estate as joint tenants. Both brothers signed a deed as grantors conveying the land to the buyer. The first brother handed the deed to the second brother with instructions to take the deed to their lawyer for approval prior to delivery. Brother two, without his brother's permission, took the deed directly to the buyer and collected the sale price. Is this a good deed as to partner one?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}