{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3848626a-f87c-537f-bd07-7122e5758a93","task_key":"all--test--3848626a-f87c-537f-bd07-7122e5758a93","task_revision_id":"1","upstream_id":"","short_description":"On September 15, a card shop sent the following fax to a printing company:…","config":"all","split":"test","body":"{\"choices\":\"['No, because under the UCC a contract for the sale of goods can be modified without consideration.', 'No, because the printing company cured the October 10 defective shipment by its tender of conforming goods on October 25.', \\\"Yes, because the printing company's shipping of the Thanksgiving cards on October 10 constituted an anticipatory breach.\\\", \\\"Yes, because the printing company's shipping of the Thanksgiving cards on October 10 constituted a present breach of contract.\\\"]\",\"question\":\"On September 15, a card shop sent the following fax to a printing company: \\\"Please deliver 100 dozen assorted Christmas cards, delivery by November 1. \\\"On October 10, the printing company shipped 100 dozen assorted Thanksgiving cards to the card shop, which were received on October 12. The following day, the card shop sent the following fax to the printing company: \\\"Be advised that your shipment is rejected. Order stipulated Christmas cards, not Thanksgiving cards. \\\"On October 15, the printing company sent the following fax to the card shop: \\\"Will ship 100 dozen assorted Christmas cards by November 1. Please ship the Thanksgiving cards back to our warehouse and bill us for the shipping charges. \\\" This fax was received by the card shop, but the card shop did not respond to it or ship the Thanksgiving cards back to the printing company. On October 25, the printing company attempted to deliver 100 dozen assorted Christmas cards to the card shop, but the latter refused to accept. Did the card shop properly reject the October 25 delivery?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}