{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8e0e74a6-47e5-553a-9bc4-842471ca5818","task_key":"all--test--8e0e74a6-47e5-553a-9bc4-842471ca5818","task_revision_id":"1","upstream_id":"","short_description":"A business purchased a computer from a seller's web site. The purchase form had…","config":"all","split":"test","body":"{\"choices\":\"['Yes, because by not returning the computer within 30 days, the purchaser was bound to the additional terms and conditions that were a part of the contract.', 'Yes, because federal law requires that arbitration must be used to attempt an initial resolution with respect to sales that take place on the internet.', \\\"No, because there was no contract formed due to the purchaser's lack of assent to the additional terms and conditions.\\\", 'No, because federal law requires that a company give 90 days for return and the 30-day provision was null and void.']\",\"question\":\"A business purchased a computer from a seller's web site. The purchase form had a prominent hyperlink connection to a page that contained \\\"important additional terms and conditions of sale,\\\" but the purchaser did not access that page. The delivered product included the additional terms in writing, along with a bold-lettered notice requiring the purchaser to return the product within 30 days if it did not accept the stated terms and conditions. After 35-days, the business became dissatisfied with the computer, and sued the seller for breach of contract. The seller demanded that the dispute be decided by private arbitration as per the additional terms and conditions to the agreement. Is the purchaser legally bound to participate in arbitration?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}