{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4ae67490-78a1-5fa5-b192-eaa4f837cad8","task_key":"all--test--4ae67490-78a1-5fa5-b192-eaa4f837cad8","task_revision_id":"1","upstream_id":"","short_description":"For the past 20 years a city by the beach has been a popular location for…","config":"all","split":"test","body":"{\"choices\":\"['There is no case or controversy.', \\\"The manufacturer's case is moot.\\\", 'The manufacturer lacks standing.', 'The case is not ripe.']\",\"question\":\"For the past 20 years a city by the beach has been a popular location for surfboarding. City residents have recently complained that the surfers are creating a public nuisance by littering the beaches, harassing sunbathers, and injuring swimmers with their surfboards. As a consequence, the city adopted an ordinance prohibiting all surfing on its beaches. The newly enacted ordinance further prohibited the sale of surfboards within the city's limits. An out of state surfboard manufacturer had planned to sell a new line of fiberglass surfboards in the city in the upcoming year. This is now precluded by the recently adopted measure. If the manufacturer seeks to enjoin application of the city ordinance, which of the following is the WEAKEST defense for the city?\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}