{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"09e36e20-cc14-52bd-98f9-c29a7547ec66","task_key":"all--test--09e36e20-cc14-52bd-98f9-c29a7547ec66","task_revision_id":"1","upstream_id":"","short_description":"On February 1, a retiree conveys his farm to an artist, and the artist duly…","config":"all","split":"test","body":"{\"choices\":\"[\\\"Grantor Index under the caterer's name to ascertain if the caterer acquired title.\\\", \\\"Grantee Index under the caterer's name only.\\\", \\\"Grantee Index under the caterer's name, then the Grantor Index under the caterer's name, and then in the Grantee Index again, this time under the artist's name to discover if he acquired title.\\\", \\\"Grantee Index under the bartender's name, then to the Grantor Index, also under the bartender's name to find out if she made any prior conveyances.\\\"]\",\"question\":\"On February 1, a retiree conveys his farm to an artist, and the artist duly records the conveyance. The following day, the artist conveys the property to a bartender; she does not record her deed. Then on February 4, the artist executes an identical conveyance of the farm to a caterer. The caterer gives the artist a check for $100,000 for the property and records the conveyance, even though he has actual knowledge of prior conveyance to the bartender. The bartender, however, records her deed on February 6. The caterer then conveys his interest in the farm to a dancer, who gives a purchase price of $115,000 to the caterer. On February 5, the dancer purchases the farm without notice of the conveyance to the bartender and duly records the deed. In conducting a title search, the dancer should pursue his investigation by looking in the\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}