{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"aea1bd57-e673-56c6-9115-d6986e2cd14c","task_key":"all--test--aea1bd57-e673-56c6-9115-d6986e2cd14c","task_revision_id":"1","upstream_id":"","short_description":"An employee had been employed by a hotel as a window cleaner for eight years…","config":"all","split":"test","body":"{\"choices\":\"['The widow was unaware of the certificate agreement until after the employee died.', 'There was no privity of contract between the widow and the hotel.', \\\"The widowin no way relied on the hotel's promise to pay the $5,000.\\\", 'There was insufficient consideration to support the certificate agreement.']\",\"question\":\"An employee had been employed by a hotel as a window cleaner for eight years when the hotel issued to him and other employees the following certificate:\\\"In appreciation of the faithful service hitherto rendered by you as an employee of this hotel, there will be paid in the event of your death, if still an employee of this hotel, to the party designated by you below as your beneficiary, the sum of $5,000. The issuance of this certificate is understood to be purely gratuitous. \\\"Upon receipt of the certificate, the employee designated his wife as beneficiary, signed it, and returned the form to the hotel. One year later, while still employed by the hotel, the employee died. In an action by the employee's widow against the hotel to recover the sum of $5,000, which of the following, if established, is the strongest argument against enforcement of the certificate agreement?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}