{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"78b65907-c60e-53ed-a0bc-666c81d9b210","task_key":"all--test--78b65907-c60e-53ed-a0bc-666c81d9b210","task_revision_id":"1","upstream_id":"","short_description":"The operator of a hot dog stand sent the following purchase order to a bakery:…","config":"all","split":"test","body":"{\"choices\":\"[\\\"The operator may either accept or reject all of the hot dog buns upon seasonable notice to the bakery, but it cannot accept only the 10-inch hot dog buns without the bakery's approval.\\\", 'The operator may either accept or reject all of the hot dog buns, or accept any commercial unit and reject the rest, but must give the bakery seasonable notice of either total or partial rejection.', 'The operator may either accept or reject all of the hot dog buns, or accept the 10-inch buns and reject the 8-inch buns, but it cannot accept any combination of the hot dog buns.', 'The operator may either accept or reject all of the hot dog buns, or, provided the bakery gives seasonable notice that the shipment was made for accommodation only, the operator may accept any combination of hot dog buns and reject the rest.']\",\"question\":\"The operator of a hot dog stand sent the following purchase order to a bakery: \\\"We are expecting an increase in business over the upcoming holidays. Please ship immediately 36 dozen 10-inch hot dog buns at your current list price of $6 per dozen. \\\"The day after receiving the purchase order, the bakery shipped 24 dozen 10-inch hot dog buns and 12 dozen 8-inch hot dog buns. The owner of the bakery had instructed his staff to include a message that the bakery did not have enough 10-inch hot dog buns to fill the order, so they were including the 8-inch hot dog buns as an accommodation. However, the shipping department forgot to €˜include the message with the shipment. Which of the following is the most accurate statement regarding the operator's legal rights following receipt of the hot dog buns?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}