{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5358a188-71f3-5473-83d3-187ab693ee59","task_key":"all--test--5358a188-71f3-5473-83d3-187ab693ee59","task_revision_id":"1","upstream_id":"","short_description":"Mort bought a property with a small rental home on it. The next door neighbor,…","config":"all","split":"test","body":"{\"choices\":\"['Mort will prevail in an action for trespass, because Tony\\\\'s use wasn\\\\'t \\\"hostile.\\\"', 'Mort will prevail because Tony\\\\'s use wasn\\\\'t \\\"open and notorious,\\\" since it was not widely known that he was on Mort\\\\'s property.', 'Tony will prevail if he used the driveway for the statutory period.', 'Tony will prevail because the easement was due to necessity.']\",\"question\":\"Mort bought a property with a small rental home on it. The next door neighbor, Tony, shared a concrete driveway that ran between the two houses but was entirely on Mort's side of the property line. Tony had been using the driveway for the past 25 years, during which time three different owners bought and sold Mort's house. When Mort applied to refinance his loan, his appraiser found an old survey showing the accurate property boundaries. Upset, Mort filed a suit against Tony for trespass. What is the likely result?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}