{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"846eb85c-5f00-5cf2-9827-fe686f6ec07f","task_key":"all--test--846eb85c-5f00-5cf2-9827-fe686f6ec07f","task_revision_id":"1","upstream_id":"","short_description":"There may be a substantial time period between contract formation and final…","config":"all","split":"test","body":"{\"choices\":\"['A wholly executory contract is where only promises have been exchanged and there has been no performance by either party.', 'A partially executed contract means that one party has completed performance while the other party has only promised.', 'An executed contract exists when both parties have fully performed and no obligations remain.', 'A partially executed contract means that at least one party has begun performance.']\",\"question\":\"There may be a substantial time period between contract formation and final completion of performance. Concerning these executory contracts, which of the following is the least correct?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}