{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"23a5904a-868a-5957-a38c-211729184053","task_key":"all--test--23a5904a-868a-5957-a38c-211729184053","task_revision_id":"1","upstream_id":"","short_description":"A homeowner was interested in changing the look of his home. He contacted an…","config":"all","split":"test","body":"{\"choices\":\"[\\\"The contractor, because his signing a contract with the homeowner and completing the work according to the plans and specifications was legally sufficient consideration to support the neighbor's promise to pay him the $10,000.\\\", 'The contractor, provided the neighbor realizes an increase in his property value as a result of the work done by the contractor.', 'The neighbor, because his promise to the contractor was illusory.', \\\"The neighbor, because at the moment the contractor accepted the homeowner's offer, he came under a pre-existing obligation, which was insufficient consideration to support the neighbor's promise.\\\"]\",\"question\":\"A homeowner was interested in changing the look of his home. He contacted an architect, who designed plans and specifications for a major \\\"facelift\\\" of the homeowner's home. The homeowner was very pleased with the plans and specifications. He showed the plans and specifications to his neighbor, who agreed that the facelift would greatly enhance the value of the homeowner's home. The homeowner contacted a contractor, who was considered to be the best in the area, to rebuild his house according to the plans and specifications. The contractor reviewed the plans and specifications and told the homeowner that he could do all the work called for by the plans and specifications for $100,000. The homeowner replied, \\\"That's a little more than I can afford. I really can only free up $80,000 for this project. Would you do it for that amount?\\\" The contractor responded, \\\"That's awfully low. I'll have to think about it,\\\" and then left. The next day, the neighbor telephoned the contractor. The neighbor explained to the contractor that he realized the value of his home would be enhanced by the improvement done to the homeowner's property. For that reason, the neighbor told the contractor he would pay him $10,000 if he would accept the homeowner's proposal and do the work called for by the plans and specifications. The contractor agreed. The next day the contractor informed the homeowner that he would accept his $80,000 offer. The contractor did all the work called for by the plans and specifications, and collected the $80,000 due him from the homeowner. However, the neighbor refused to pay the contractor the $10,000. If the contractor brings a breach of contract action against the neighbor, judgment for whom?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}