{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3c16f4fe-eb9c-5e47-bf0f-87242d05e709","task_key":"all--test--3c16f4fe-eb9c-5e47-bf0f-87242d05e709","task_revision_id":"1","upstream_id":"","short_description":"A builder contracted in writing to construct a small greenhouse on a homeowner's…","config":"all","split":"test","body":"{\"choices\":\"[\\\"$3,000, the increase in the value of the homeowner's property.\\\", '$10,000, the total cost expended by the builder at the time of the breach.', \\\"$14,000, the total cost expended by the builder ($10,000) plus the builder's expected profit ($5,000), minus the loss avoided by the resale of the unused materials ($1,000).\\\", '$15,000, the contract price ($20,000) minus the costs saved by the breach ($5,000).']\",\"question\":\"A builder contracted in writing to construct a small greenhouse on a homeowner's property for $20,000, payable upon completion. After the builder had spent $9,000 framing the greenhouse and an additional $1,000 for materials not yet incorporated into the greenhouse, the homeowner wrongfully ordered the builder to stop work. The builder then resold the unused materials that he had already purchased for the greenhouse to another contractor for $1,000. At the time the homeowner stopped the work, it would have cost the builder an additional $5,000 to complete the project. The an additional $5,000 to complete the project. The partially built greenhouse increased the value of the homeowner's property by $3,000. In a suit by the builder against the homeowner, how much is the builder likely to recover?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}