{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9179e824-028b-518b-9891-6c63f0685a1e","task_key":"all--test--9179e824-028b-518b-9891-6c63f0685a1e","task_revision_id":"1","upstream_id":"","short_description":"Fifteen years ago, two men who were fishing buddies moved onto vacant rural land…","config":"all","split":"test","body":"{\"choices\":\"[\\\"For the man who is still alive and the deceased man's heir, because the men acquired title as tenants in common.\\\", 'For the man who is still alive, because he is the surviving adverse possessor.', 'For the woman, because the use was changed by the men while they were in possession.', 'For the woman, because title cannot be claimed by two adverse possessors simultaneously.']\",\"question\":\"Fifteen years ago, two men who were fishing buddies moved onto vacant rural land owned by a woman they didn't know and built a small fishing shack on it. Twelve years ago, the men replaced the shack with a fish processing plant and a commercial fishing boat dock. The men maintained their commercial fishery operation on the land until one of them died intestate last year, leaving a sole heir. The period of time to acquire title by adverse possession in the jurisdiction is 10 years. The woman has now become aware of the changes that have occurred on the land. In an action to determine title, for whom should the court decide?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}