{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"70ec3ddb-b1f0-5bc6-b5c2-d3d509ad96be","task_key":"all--test--70ec3ddb-b1f0-5bc6-b5c2-d3d509ad96be","task_revision_id":"1","upstream_id":"","short_description":"On February 1, a man dispatched the following letter to a mechanic:\"My car has…","config":"all","split":"test","body":"{\"choices\":\"['The mechanic had not completed performance before the man revoked his offer.', \\\"The man's offer could only be accepted by a return promise.\\\", 'Because the man made his offer by letter, the mechanic could accept only in the same manner.', 'Although the mechanic was preparing to perform the repair work, he had not begun the requested acts of acceptance when the man revoked his offer.']\",\"question\":\"On February 1, a man dispatched the following letter to a mechanic:\\\"My car has not been running very well lately. I'll pay you $275 if you will change the oil, replace the oil filter, and adjust the carburetors by February 10. \\\"The mechanic received the man's letter on February 3. That same day, he telephoned an auto supply company and ordered the necessary materials to perform the repair work. Two days later, the mechanic met the man at a party and this conversation took place:The man: \\\"Disregard the letter I sent you last week. \\\"The mechanic: \\\"No way, man, I already ordered the materials on from the auto supply company. \\\"The man: \\\"Sorry, but I sold my car yesterday, so forget the repair work. \\\"If the mechanic initiates suit for breach of contract, which of the following is the man's strongest argument that no enforceable contract was formed between the parties?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}