{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"aa53954d-972c-590b-ab45-37e3f74ec1fb","task_key":"all--test--aa53954d-972c-590b-ab45-37e3f74ec1fb","task_revision_id":"1","upstream_id":"","short_description":"A police officer received a call from a friend who owned a business. The friend…","config":"all","split":"test","body":"{\"choices\":\"['No, because the officer received enough facts from the owner to establish the elements of the criminal charges that he filed against the former employee.', 'Yes, there were sufficient facts for the former employee to establish the basic elements of the malicious prosecution tort.', 'No, because the business owner knew that it was the former employee who made the calls even if he could not prove it.', 'Yes, the officer committed abuse of legal process when he improperly initiated the case.']\",\"question\":\"A police officer received a call from a friend who owned a business. The friend told him that a former employee, who was a \\\"hothead\\\", was making harassing phone calls and threats. He faxed the officer a oneparagraph summary of the matter. The officer questioned the prior employee, who became verbally abusive and vehemently denied making the calls. The officer arrested him for criminal harassment and wrongful use of a communications device, stating, \\\"I'm going to teach you a lesson.\\\" The criminal case was thrown out, however, at the preliminary hearing when the police could not produce proof that the former employee made any phone calls to the business. The former employee then sued the police officer and the business owner for the tort of malicious prosecution. Leaving aside any considerations of immunity for the officer, can the former employee allege facts sufficient to support a malicious prosecution case?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}