{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4562383e-fa5b-53ec-abb6-106d6d2c8f20","task_key":"all--test--4562383e-fa5b-53ec-abb6-106d6d2c8f20","task_revision_id":"1","upstream_id":"","short_description":"A husband and wife own a piece of land as tenants by the entirety. When there…","config":"all","split":"test","body":"{\"choices\":\"['Yes, the entireties ownership was severed by the valid deed from mother to her son, and son now owns one-half of the property as tenants in common with the husband.', \\\"Yes, the son became a tenant by the entireties with his mother's husband upon his mother's death.\\\", \\\"No, the mother's deed was a nullity because the entireties estate can only be broken with the consent of both parties; the husband became the sole fee simple owner on wife's death.\\\", 'No, a mother cannot convey a real estate interest to a son without getting the approval of all of her children.']\",\"question\":\"A husband and wife own a piece of land as tenants by the entirety. When there were marital problems, wife secretly conveyed her interest in the real estate to her youngest son from a prior marriage so that he would always have a place to live. Wife died and the husband filed to evict his stepson. According to the majority view among the states, can the stepson prevail by asserting his deed from his mother?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}