{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6f365df9-4bf9-59ad-b336-f58733017dee","task_key":"all--test--6f365df9-4bf9-59ad-b336-f58733017dee","task_revision_id":"1","upstream_id":"","short_description":"In 1985, a widow, the undisputed owner of a cottage, leased it to a tenant for a…","config":"all","split":"test","body":"{\"choices\":\"['the widow died.', 'the tenant discontinued paying rent.', \\\"the tenant's lease with the widow expired.\\\", 'the tenant subjectively believed that he no longer had permission to possess the cottage.']\",\"question\":\"In 1985, a widow, the undisputed owner of a cottage, leased it to a tenant for a term of seven years. Rent was to be paid in installments due on the first day of each month. One year later, in 1986, the widow died leaving no heirs. In her will, the widow left her entire estate to the Boy Scouts of America. The cottage was not specifically mentioned in the will. One month after the widow died, the tenant, having learned of her death, decided to remain on the property, but stopped paying rent. The Boy Scouts of America organization was unaware that the widow made a gift to the organization until 2009, when attorneys for the organization conducted an inventory of testamentary gifts to the Boy Scouts of America, which revealed that they had a claim to ownership of the cottage. The statutory period for adverse possession in this jurisdiction is 20 years. The tenant's statutory period for adverse possession began to run when\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}