{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"63436b53-ebb1-5fd0-999b-7e463b3c6ddf","task_key":"all--test--63436b53-ebb1-5fd0-999b-7e463b3c6ddf","task_revision_id":"1","upstream_id":"","short_description":"A farmer was the owner of a 20-acre tract that was situated just south of a…","config":"all","split":"test","body":"{\"choices\":\"[\\\"win, because his deed antedated the woman's deed.\\\", 'win, because no encumbrances were mentioned in his deed.', 'lose, because the woman has an easement by necessity.', 'lose, because the woman has an express easement.']\",\"question\":\"A farmer was the owner of a 20-acre tract that was situated just south of a major boulevard, a street that ran east and west. The farmer's tract was located next to an adjacent 300-acre ranch to the east. Immediately to the west of the farmer's parcel was a 100-acre tract. The farmer subdivided his property into two 10-acre parcels:Parcel 1 was the northern half and bordered along the major boulevard; Parcel 2 was the southern sector and abutted a river to the south. In March 1997, the farmer conveyed Parcel ito a man by warranty deed. No encumbrances were mentioned in the deed. Then in September 1997, the farmer conveyed Parcel 2 by warranty deed to a woman. Both the man and the woman promptly recorded their deeds with the County Recorder's Office. In 1965, the farmer constructed a driveway from what is now Parcel 2, extending over Parcel 1, where it connected with the major boulevard. This driveway lies across what is now Parcel 1 and was used continuously by the farmer until 1997 when he conveyed his property in parcels to the man and the woman. When the woman took possession of Parcel 2, she immediately began to use the drive way across Parcel 1. Thereafter, the man requested that the woman cease to use the driveway over Parcel 1. After the woman refused, the man brought an appropriate action to enjoin the woman from using the driveway. In this action, the man will\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}