{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d4a259b2-9c2a-55c2-a7cf-66933f22a2d3","task_key":"all--test--d4a259b2-9c2a-55c2-a7cf-66933f22a2d3","task_revision_id":"1","upstream_id":"","short_description":"A contractor agreed with a city government to build it a bridge. The contractor…","config":"all","split":"test","body":"{\"choices\":\"[\\\"No, because the city's failure to perform has frustrated the purpose of the liquidated damages clause, making liquidated damages in this case unnecessary due to no damages suffered.\\\", 'Yes, because the contract provision for liquidated damages has been breached and the city had no obligation to connect a road.', 'Yes, because the bridge delays caused the city to delay finishing the road, thereby creating the need to enforce the provision for liquidated damages.', 'No, because the city breached the contract by not connecting a road to the bridge.']\",\"question\":\"A contractor agreed with a city government to build it a bridge. The contractor was guilty of undue delay in getting the bridge construction finished. The contract had a liquidated damages clause that provided for a deduction from the contract price for each day of delay in completing the bridge. The formula for the deductions from the contract price was based on how much traffic flow was turned away. The city tried to deduct the damages from the contract price. The contractor, however, pointed out that the city had not yet connected a road to the bridge so that there was no traffic flow and hence no damage to the city. Will the court uphold the liquidated damages clause in favor of the city?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}