{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f4126de9-e490-5c14-8b7f-2a8ada8d861a","task_key":"all--test--f4126de9-e490-5c14-8b7f-2a8ada8d861a","task_revision_id":"1","upstream_id":"","short_description":"A woman is engaged in the retail sale of widgets throughout the United States.…","config":"all","split":"test","body":"{\"choices\":\"[\\\"No, because the woman's order was too indefinite to constitute an offer, since it didn't contain a price term.\\\", \\\"No, because even if the woman's order was a valid offer, it was effectively revoked prior to acceptance.\\\", \\\"Yes, because the woman's order created a valid option contract.\\\", \\\"Yes, because the manufacturer's fax of March 10 constituted an acceptance of the woman's offer.\\\"]\",\"question\":\"A woman is engaged in the retail sale of widgets throughout the United States. On March 7, the woman sent the following purchase order to a manufacturer of widgets:\\\"Promptly ship 1,000 widgets, catalogue #B4-IEU, at the current wholesale price to our warehouse. Thank you for your attention to this matter. \\\"This order was received by the manufacturer on March 9. The next day, the manufacturer replied by fax:\\\"Your order has been received. Shipment date will be March 12. Price $50 for each widget delivered. Be advised that these are the last widgets, under catalogue #B4-IEU, that we can deliver, since this variety is no longer being manufactured. \\\"Upon receipt of the fax, the woman immediately sent the following fax:\\\"Cancel our previous order for 1,000 widgets under catalogue #B4-IEU. Price too high. \\\"Assume $50 per widget was the current wholesale market price. Was an enforceable contract in effect between the woman and the manufacturer?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}