{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"58eab57e-79b0-5dac-9edd-1efbced27951","task_key":"all--test--58eab57e-79b0-5dac-9edd-1efbced27951","task_revision_id":"1","upstream_id":"","short_description":"In a written contract, a seller agreed to deliver to a buyer 1,000 widgets at a…","config":"all","split":"test","body":"{\"choices\":\"['nothing, because the buyer never assented to the assignment.', 'nothing, because the buyer never received the widgets.', 'the contract price of$10,000.', 'the difference between the contract price and the market value of the widgets.']\",\"question\":\"In a written contract, a seller agreed to deliver to a buyer 1,000 widgets at a stipulated price of $10 each, FOB at the seller's place of business. The contract stipulated that \\\"any party who wishes to assign this contract must have the written consent of the other party. \\\" On March 1, the seller placed the widgets on board a cargo vessel that was destined to transport the widgets to the buyer. On March 2, the buyer received the following telegram from the seller:\\\"Please be advised that the widgets are in transit. In addition, I hereby assign all my rights under our contract to our creditor. \\\"The buyer did not consent to the assignment. The next day, the ship carrying the widgets sank in a violent storm, destroying its entire cargo. If the creditor brings an appropriate action against the buyer, the former will most likely recover\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}