{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b55a49a7-931a-52ea-9e4e-a6075f5b33d1","task_key":"all--test--b55a49a7-931a-52ea-9e4e-a6075f5b33d1","task_revision_id":"1","upstream_id":"","short_description":"On January 1, a manufacturer of widgets received an e-mail from a widget…","config":"all","split":"test","body":"{\"choices\":\"['It constitutes a counteroffer, because it contains different terms from those contained in the original offer.', 'It constitutes a rejection, because the offer implied limited acceptance to the terms contained therein.', 'It creates an enforceable contract with delivery of 500 widgets in February and delivery of 500 widgets in March.', 'It creates a reformation integrating the terms of both writings.']\",\"question\":\"On January 1, a manufacturer of widgets received an e-mail from a widget distributor about purchasing widgets. The manufacturer sent the following returh e-mail: \\\"Have 1,000 widgets available at $10 each for February delivery. Be advised that this offer will remain open until February 1. \\\"On January 31, the distributor sent the following fax to the manufacturer: \\\"Your offer is hereby accepted, but request delivery of 500 widgets in February and 500 widgets in March. \\\" The manufacturer received the fax the same day, but did not respond. Which of the following is the most accurate statement regarding the legal effect of the distributor's January 31 fax?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}