{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4b6634c5-975b-5102-8270-48da6f291871","task_key":"all--test--4b6634c5-975b-5102-8270-48da6f291871","task_revision_id":"1","upstream_id":"","short_description":"A restaurant ran a promotion in a local newspaper, stating the…","config":"all","split":"test","body":"{\"choices\":\"['The contract is unenforceable as violative of the statute of frauds.', 'The contract is unenforceable, because of indefiniteness.', 'The contract may be enforceable if it is later modified to include the price term.', 'The contract is enforceable with reasonable price being fixed at time of delivery.']\",\"question\":\"A restaurant ran a promotion in a local newspaper, stating the following:\\\"MOTHER'S DAY SPECIALWe will be open for brunch on Mother's Day from 10 am to 2 pm offering an extensive selection of dishes to honor mothers of all ages. Call us to reserve your table. \\\"The response to the promotion was more than the restaurant expected, and the restaurant was soon overbooked for the Mother's Day brunch. On the day before Mother's Day, the restaurant owner decided to double-check inventory to make sure the restaurant had enough food and supplies to handle the large Mother's Day crowd. To her horror, she discovered that the restaurant was almost out of eggs. Knowing that a large supply of eggs would be needed for the omelet station, the owner immediately sent the following e-mail to her egg supplier:\\\"Desperately need 20 flats of Grade AA eggs for tomorrow's brunch. Money is no object. The eggs must be delivered today. \\\"The supplier e-mailed back:\\\"No problem! I'll load them on the truck and deliver them within the hour. \\\"With respect to the agreement between the owner and the supplier, which of the following statements is most accurate regarding the omittance of a fixed contract price?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}