{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5ec1b806-5db0-5dd8-9c1a-66e08935aea6","task_key":"default--test--1734","task_revision_id":"1","upstream_id":"1734","short_description":"An avowed member of an antigovernment organization was elected president of a…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['The president of a union cannot sue for defamation based on statements made during a legislative hearing.', 'Public figures must prove that false and defamatory statements were made with knowledge of their falsity or with reckless disregard for the truth.', 'Truth is an absolute defense to a defamation claim.', 'A senator cannot be held accountable for statements made during an investigation, regardless of their truth or falsity.', \\\"Congressional committees do not have the authority to violate a person's Fifth Amendment privilege against self-incrimination.\\\", 'It is not a denial of due process or of First Amendment rights for a congressional investigative committee member to make such utterances.', 'The constitutional requirement for actual malice must be proved by the party defamed in order to recover in a defamation suit.', \\\"The president must prove that the senator's statements were made with the intent to cause harm.\\\", \\\"A senator's statements during a legislative hearing are protected by legislative immunity.\\\", 'A congressman shall not be questioned in any other place for any speech or debate made by him during a congressional hearing.']\",\"question\":\"An avowed member of an antigovernment organization was elected president of a union. A senator, in his investigation of infiltration by antigovernment organizations of national labor unions, found a provision in a law passed by Congress that makes it a crime for a member of an antigovernment organization to act as an official of a labor union. After a subsequent legislative hearing, the president is dismissed from his position by the executive committee of the union. During a legislative hearing, the senator made derogatory statements about the president's involvement in an antigovernment organization. In determining whether the president has a valid cause of action against the senator for defamation, which of the following most accurately summarizes the applicable rule of law?\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}