{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"28018be9-c042-58d9-9d63-7ae6e5f2ea1c","task_key":"all--test--28018be9-c042-58d9-9d63-7ae6e5f2ea1c","task_revision_id":"1","upstream_id":"","short_description":"A small town in the Northeast developed the biggest ice sculpture in the world…","config":"all","split":"test","body":"{\"choices\":\"['No, because there is a legitimate state or local interest here which is promoted by an even-handed procedure to control the flow of traffic for public safety, and the impact on commerce is incidental.', 'No, because the food stands do not have a significant commerce clause claim in that they are still able to sell food, and what they do does not affect interstate commerce.', \\\"Yes, because the state is interfering with the food cart owners' legitimate business operations, which impact heavily on interstate commerce.\\\", 'Yes, because the local interest is favored in a discriminatory manner against all of the food cart owners from other states.']\",\"question\":\"A small town in the Northeast developed the biggest ice sculpture in the world due to a massive snow, a deep freeze, and viral coverage on the social media. Hundreds of tourists poured into the area to work on the large block of ice. They made a gigantic ice palace for a variety of Disney princesses. To handle the needs of a great number of tourists, food vendors came from all over and set up their carts. To solve the problem of congestion, safety, and insufficient security, the town passed an ordinance restricting all street vendors to a specified parking lot area. The food vendors and others were losing money under the regulation. Would a commerce clause challenge to the parking lot requirement be successful by the food stand owners?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}