{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"eb039028-e2f2-5e7a-bf2a-01c221d4fb13","task_key":"all--test--eb039028-e2f2-5e7a-bf2a-01c221d4fb13","task_revision_id":"1","upstream_id":"","short_description":"An employee successfully negotiated a lucrative contract for her employer. As a…","config":"all","split":"test","body":"{\"choices\":\"['It is enforceable, because the employee conferred a material benefit on the employer by negotiating the lucrative contract.', 'It is enforceable, because the employer was morally obligated to pay the bonus.', 'It is unenforceable, because it was not supported by legally sufficient consideration.', 'It is unenforceable, because it was not in writing.']\",\"question\":\"An employee successfully negotiated a lucrative contract for her employer. As a result, her employer orally promised her a $10,000 bonus payable at the end of the year because of the employee's \\\"good work. \\\" At the end of the year, the employer informed the employee that the company's profits were not as large as he expected, so the promised bonus would not be paid. Which of the following is the legal effect of the employer's promise to pay the bonus to the employee?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}