{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9a1ed9c2-1f05-51d6-a637-57a068928ef8","task_key":"all--test--9a1ed9c2-1f05-51d6-a637-57a068928ef8","task_revision_id":"1","upstream_id":"","short_description":"A homeowner entered into a written contract with a house painter to have his…","config":"all","split":"test","body":"{\"choices\":\"[\\\"Payment of the $10,000 by the homeowner would be an express condition precedent to the house painter's duty of performance.\\\", \\\"Payment of the $10,000 by the homeowner would be an express condition subsequent to the house painter's duty of performance.\\\", \\\"The house painter's performance under the contract would be an express condition precedent to the homeowner's duty of payment of the $10,000.\\\", 'The performances of the homeowner and the house painter were, in essence, concurrent conditions.']\",\"question\":\"A homeowner entered into a written contract with a house painter to have his house painted for $10,000. The contract stated in part: \\\"It is agreed that the house painter will paint the house using off-white latex paint, and will finish the job within 30 days from the execution of this agreement. If the homeowner finds the completed job to be satisfactory, he will pay the house painter $10,000 within one week after the job is completed. \\\"Which of the following is the most accurate statement regarding the homeowner's contractual obligation to pay the house painter $10,000?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}