{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2e73f076-a714-5c21-b19e-f4761b7139dc","task_key":"all--test--2e73f076-a714-5c21-b19e-f4761b7139dc","task_revision_id":"1","upstream_id":"","short_description":"On March 1, a homeowner hired a landscaper to landscape his front yard. On March…","config":"all","split":"test","body":"{\"choices\":\"[\\\"The landscaper's promise created an enforceable unilateral contract.\\\", \\\"The landscaper's promise created an enforceable bilateral contract.\\\", \\\"The landscaper's promise was voidable, since it was not in writing.\\\", \\\"The landscaper's promise was illusory, thereby creating an unenforceable contract.\\\"]\",\"question\":\"On March 1, a homeowner hired a landscaper to landscape his front yard. On March 25, as the landscaper was almost finished with the work on the front yard, the homeowner said to the landscaper, \\\"I'm very pleased with your work to date. If you are willing, I would like you to landscape my backyard, on the same terms and conditions as our existing contract, the work to be completed by May 1. If you can meet that deadline, I'll pay you $10,000 at that time. \\\" The landscaper replied, \\\"Agreed. Let's shake hands on it. \\\" They shook hands. What is the probable legal effect of the landscaper's promise on March 25 to landscape the backyard?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}