{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"77e8080a-b2d2-53e5-a9df-be44a305b3cf","task_key":"default--test--1673","task_revision_id":"1","upstream_id":"1673","short_description":"Several states have enacted laws shielding reporters from being compelled to…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['Congress has the authority under the commerce clause to regulate the flow of news.', 'Acts of Congress are the supreme law of the land and take precedence over any conflicting state laws.', 'Congress is essentially reaffirming the free speech guarantees of the First and Fourteenth Amendments.', 'Under Article I, Section 8, Congress has the authority to secure to authors and inventors the exclusive right to their respective writings and discoveries.']\",\"question\":\"Several states have enacted laws shielding reporters from being compelled to release the names of confidential sources. Now, Congress, under intense lobbying pressure from the press, proposes to enact legislation forbidding any state from requiring journalists to reveal the sources of their news articles in civil suits. Which of the following is the strongest constitutional argument in support of this proposed law?\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}