{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"31860157-24a3-5f22-8465-6cdcfd42f578","task_key":"all--test--31860157-24a3-5f22-8465-6cdcfd42f578","task_revision_id":"1","upstream_id":"","short_description":"A womam owned a farm. She granted to a neighbor, the owner of an adjacent tract,…","config":"all","split":"test","body":"{\"choices\":\"['lose, because he abandoned his easement.', 'lose, because he did not use his easement for the statutory period of 20 years.', 'lose, because, rather than using his easement, he used all of the farm.', 'win, because mere non-use of an easement does not extinguish it.']\",\"question\":\"A womam owned a farm. She granted to a neighbor, the owner of an adjacent tract, an easement of way. The woman then went to Japan to live. The neighbor then moved into possession of the farm and used it openly and exclusively, paying the taxes for 23 years. He did not use his easement during that period. The woman returned and tried to evict the neighbor from the farm. The court held that the neighbor had acquired the farm by adverse possession. The neighbor then sold the farm back to the woman, who then put a chain across the easement. The neighbor has now brought an action to remove the chain. In most jurisdictions, the neighbor will\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}