{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"12ea2da1-72a0-5192-8e20-a091576cbe70","task_key":"all--test--12ea2da1-72a0-5192-8e20-a091576cbe70","task_revision_id":"1","upstream_id":"","short_description":"One morning, an employee arrived at work and found his boss passed out on the…","config":"all","split":"test","body":"{\"choices\":\"[\\\"&s per the boss's oral promise, the employee had an enforceable lifetime employment contract.\\\", 'The boss had a duty to pay the employee reasonable compensation for saving his life, based upon a contract implied-in-fact.', \\\"The employee's act of saving the boss's life was sufficient past consideration to render enforceable the boss's subsequent promise.\\\", \\\"Since the employee gratuitously rendered assistance to the boss, there was insufficient consideration to support the boss's subsequent promise to provide the employee with lifetime employment.\\\"]\",\"question\":\"One morning, an employee arrived at work and found his boss passed out on the floor of his office. The employee determined that his boss was not breathing, immediately rendered CPR to his boss, and succeeded in reviving him. The employee then called the paramedics, who took the boss to the hospital. Two week later, the boss returned to work. Grateful for the employee's quick action in saving his life, the boss said to the employee, \\\"You'll have ajob with me for life. \\\"Which of the following best characterizes the legal relationship between the boss and the employee on that date?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}