{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"179dfcd3-bb9f-505a-84b9-7fb764294437","task_key":"all--test--179dfcd3-bb9f-505a-84b9-7fb764294437","task_revision_id":"1","upstream_id":"","short_description":"Kendall and Thornton agree to form a partnership, but both agree that only…","config":"all","split":"test","body":"{\"choices\":\"[\\\"enforceable, as the partners' agreement cannot withhold statutory authority of a general partner to bind the partnership.\\\", \\\"enforceable, as Clark has no knowledge of Thornton's lack of authority.\\\", 'unenforceable, as Thornton is unauthorized to execute the contract by the partner agreement.', \\\"unenforceable, as Clark had an obligation to confirm Thornton's authority prior to entering into a service contract with the partnership.\\\"]\",\"question\":\"Kendall and Thornton agree to form a partnership, but both agree that only Kendall will manage the business and make all business decisions and execute all contracts with third parties. After that time, Thornton then enters into a long-term service contract for the partnership with Clark, who does not know of the internal agreement. The contract of Thornton with Clark is\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}