{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7ee9ba01-dc9c-5639-be82-677e6d65d2d8","task_key":"all--test--7ee9ba01-dc9c-5639-be82-677e6d65d2d8","task_revision_id":"1","upstream_id":"","short_description":"A state built a baseball stadium and issued bonds to finance its construction.…","config":"all","split":"test","body":"{\"choices\":\"[\\\"constitutional, because it is a justifiable exercise of the state's police power.\\\", 'constitutional, because of the clear and present danger of baseball playing in the state.', \\\"unconstitutional, because it impairs the obligation of the bondholders'contract.\\\", 'unconstitutional, because it violates the due process rights of the baseball team owners.']\",\"question\":\"A state built a baseball stadium and issued bonds to finance its construction. The bond agreement provided that for the first five years the stadium was in operation, at least $2 from each admission charge would be used to repay the bond debt. The bond agreement further stipulated that if the proceeds from the admission charges during the first five years were not sufficient to repay the bondholders, then at least $1 from each admission charge for the next five years would be applied to make the necessary bond payments. Assume that three years after the stadium had been in operation, a subsequent session of the state legislature passed a bill entirely prohibiting baseball because four players were killed in playing mishaps. This statute is probably\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}