{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7ce339e3-1671-5340-8333-bdb18baf0aab","task_key":"all--test--7ce339e3-1671-5340-8333-bdb18baf0aab","task_revision_id":"1","upstream_id":"","short_description":"A manager's competitor sent a defamatory letter to the manager accusing him of…","config":"all","split":"test","body":"{\"choices\":\"['Yes, it will dismiss on the basis that the publication is made to the manager alone.', \\\"Yes, it will dismiss on the basis that the language is not damaging to the manager's reputation.\\\", 'No, it will not dismiss because the circumstances show that all of the elements of defamation are all present.', 'No, it will not dismiss because a plaintiff in a defamatory action has an absolute right to a jury trial to prove defamation.']\",\"question\":\"A manager's competitor sent a defamatory letter to the manager accusing him of professional incompetence and calling him one of the worst businessmen in town. It was addressed to the manager. He read it, put it in a private drawer, and did not read it again. Later, he tried to sue the competitor for defamation as a result of the letter. Will the court likely grant the defendant's motion to dismiss, and on what grounds? Base your answer on the common law definition of defamation.\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}