{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6d189b93-6ce6-52ea-b647-40e72967843e","task_key":"all--test--6d189b93-6ce6-52ea-b647-40e72967843e","task_revision_id":"1","upstream_id":"","short_description":"Congress enacted a statute taxing the sale of automobiles. In an inseverable…","config":"all","split":"test","body":"{\"choices\":\"['It is constitutional because Congress could reasonably believe that such a subsidy to this particular museum will benefit the cultural life of the nation as a whole.', 'It is constitutional because Congress can demonstrate that such a subsidy is rationally related to a legitimate public interest.', 'It is unconstitutional because it is not apportioned among the several states on an equitable basis.', 'It is unconstitutional because it advances the welfare only of thosepersons who are interested in cleanair.']\",\"question\":\"Congress enacted a statute taxing the sale of automobiles. In an inseverable portion of that same law, the entire proceeds of the tax are appropriated on a continuing basis for direct payments to an education fund. The education fund is dedicated to educating people about the importance of mass transportation as an alternative to automobiles, which the fund considers a major source of pollution. As a matter of constitutional law, which of the following statements concerning the continuing federal appropriation to the education fund is most accurate?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}