{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e67bc114-6cd0-5622-94bb-1fc089c04d8e","task_key":"all--test--e67bc114-6cd0-5622-94bb-1fc089c04d8e","task_revision_id":"1","upstream_id":"","short_description":"Expecting an increase in business for the holiday season, an owner of a retail…","config":"all","split":"test","body":"{\"choices\":\"['It effectuated a valid reformation of their original written contract.', 'It effectuated a valid modification of their original written contract.', 'It effectuated a novation of their original written contract.', 'It did not alter the rights and obligations of the parties under the terms of their original contract.']\",\"question\":\"Expecting an increase in business for the holiday season, an owner of a retail store decided to hire another employee. On October 31, the owner entered into a written contract with a worker that provided that the worker would be employed for the months of November and December to work at the retail store for $2,000 per month. At the end of November, the owner noticed that business had not increased as much as he had expected. The owner informed the worker that unless he agreed to take a cut in his salary, he would be fired. Reluctantly, on December 1, the worker orally consented to a salary reduction of $500 for the month of December. Which of the following statements regarding the December 1 agreement between the owner and the worked is most accurate?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}