{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8d7e5b1b-5dc4-5cd6-ace3-a12468d2f0df","task_key":"all--test--8d7e5b1b-5dc4-5cd6-ace3-a12468d2f0df","task_revision_id":"1","upstream_id":"","short_description":"In a jurisdiction using the grantor €”grantee indices, the following events have…","config":"all","split":"test","body":"{\"choices\":\"['Only the daughter has a cause of action against the woman.', 'Only the mortgage company has a cause of action against the woman.', 'Both the daughter and the mortgage company have causes of action against the woman.', 'Neither the daughter nor the mortgage company has a cause of action against the woman.']\",\"question\":\"In a jurisdiction using the grantor €”grantee indices, the following events have occurred in the order listed below:(1) In 1993, a woman mortgaged a tract of land to a mortgage company to secure a note for $25,000, due on December 31, 1993, with 9'/2 percent interest per annum. (2) In 1996, the mortgage company recorded the mortgage on the tract of land. (3) In 2007, in a signed writing, which the woman delivered to her daughter, the woman promised to convey the tract of land to her daughter by quitclaim deed and pay the mortgage debt when it came due. (4) In 2008, the woman delivered to the daughter a quitclaim deed that made no reference to the mortgage. If the woman thereafter defaulted on the mortgage debt, which of the following is probably correct?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}