{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"98455662-adc9-5f2b-946f-e4593e27394e","task_key":"all--test--98455662-adc9-5f2b-946f-e4593e27394e","task_revision_id":"1","upstream_id":"","short_description":"Recently, Congress enacted a statute requiring all boat owners to register their…","config":"all","split":"test","body":"{\"choices\":\"['No, because most stolen boats remain within the state in which they were stolen.', 'No, because the registration of boats is a matter reserved to the states by the Tenth Amendment.', 'Yes, because Congress could determine that the transportation of stolen boats affects interstate commerce.', 'Yes, because Congress has the power to regulate property for the general welfare.']\",\"question\":\"Recently, Congress enacted a statute requiring all boat owners to register their boats with a newly created federal boat registry. Among the purposes of the statute are the prevention of theft of boats in coastal waters and the protection of the rights of individual boat owners throughout the United States. Congress enacted the statute despite the fact that all states require boat owners to register their craft with the state department of motor vehicles. In addition, there is uncontradicted evidence that most stolen boats are kept or resold in the state in which the theft occurred. Nonetheless, an increasing number of boats are transported to other states and other countries for resale. Is the statute likely to be held constitutional?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}