{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bd06baca-93fd-5692-b212-6fc030699f7b","task_key":"all--test--bd06baca-93fd-5692-b212-6fc030699f7b","task_revision_id":"1","upstream_id":"","short_description":"An owner and operator of a restaurant contracted in writing with a produce…","config":"all","split":"test","body":"{\"choices\":\"['The evidence is admissible to show frustration of purpose.', 'The evidence is admissible to show that the written agreement was subject to an oral condition precedent.', \\\"The evidence is barred, because the written contract appears to be a complete and total integration of the parties' agreement.\\\", 'The evidence is barred, because the oral agreement is within the statute of frauds.']\",\"question\":\"An owner and operator of a restaurant contracted in writing with a produce distributor to buy 50 pounds of heirloom tomatoes. At the time the contract was signed, the owner orally said to the distributor, \\\"We do have an understanding that our chef must approve the quality of the heirloom tomatoes before I will pay you. \\\" The distributor acknowledged the owner's request and responded, \\\"If you say so. \\\"Thereafter, the distributor delivered the heirloom tomatoes to the owner. After inspecting the tomatoes, the chef refused to give his approval, because he felt that the tomatoes were not of sufficient quality. As a result, the owner refused to accept and pay for the tomatoes. The distributor brought a breach of contract action against the owner because he refused to pay for the tomatoes. How should the court rule on the owner's offer to prove, over the distributor's objection, that the chef refused to approve the tomatoes that were delivered?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}