{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"05aea9b2-0001-5138-8c2f-b9b088e86f0a","task_key":"all--test--05aea9b2-0001-5138-8c2f-b9b088e86f0a","task_revision_id":"1","upstream_id":"","short_description":"A businessperson sent his employee, an administrative assistant to represent him…","config":"all","split":"test","body":"{\"choices\":\"['Yes, because the furnishing of the indicia of authority to act to the employee was sufficient proof to bind the principal.', \\\"Yes, because the principal is bound to the employee's actions whenever he sends an employee to attend a convention on his behalf.\\\", 'No, because people dealing with an assistant at a convention have a duty to determine whether that person is in fact an authorized agent.', 'No, because the technological revolution makes it easy these days for a potential customer to first confirm the existence of actual authority.']\",\"question\":\"A businessperson sent his employee, an administrative assistant to represent him at a conference where business deals are often negotiated. The principal gave the assistant all of the materials to set up a table with the principal's cards, brochures, promotional materials, price lists and even some order forms with businessperson's logo on them. In addition, the assistant represented to third parties that she was there officially representing the principal and that she was authorized to execute contracts on his behalf. The assistant negotiated a deal for the businessperson with a third party, which the businessperson refused to honor because he did not like the terms that were negotiated. Will the third party likely prevail in enforcing the contract against the businessperson?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}