{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ac0ce121-9f27-51e9-822e-6dda459fb63b","task_key":"all--test--ac0ce121-9f27-51e9-822e-6dda459fb63b","task_revision_id":"1","upstream_id":"","short_description":"A son loaned his father a large sum of money. The father signed a 10-year…","config":"all","split":"test","body":"{\"choices\":\"['No, because the mortgage was granted before the tenancy in common was created.', 'No, because the three siblings took the farm as tenants in common rather than as joint tenants with right of survivorship.', 'Yes, because a fiduciary relationship exists among tenants in common.', 'Yes, because their three interests are equal.']\",\"question\":\"A son loaned his father a large sum of money. The father signed a 10-year promissory note and secured the note with a mortgage on his farm. The mortgage was promptly recorded. The next year, the father died intestate. The father's heirs were the son and his two sisters. The sisters first learned of the mortgage just after their father died. The sisters now assert that the son, their brother, holds the mortgage for their benefit as well as for himself because as a tenant in common with his sisters, he has a fiduciary duty toward them. There are no applicable statutes. Are the sisters correct?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}