{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"17b41f0d-be80-50d6-8ff4-586dae4e34fa","task_key":"default--test--1752","task_revision_id":"1","upstream_id":"1752","short_description":"A city enacted an ordinance prohibiting the singing and chanting of songs from…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['The ordinance deprives persons of their liberty without due process of law because the ordinance is not related to any legitimate community interest.', 'The ordinance is unjust as it discriminates against those who are not religious.', 'The ordinance is not fair because it only applies to two or more persons, thus single individuals can create noise without consequence.', 'The ordinance deprives the persons of the equal protection of the laws by impermissibly distinguishing between religiously inspired singing and all forms of singing.', \\\"The ordinance directly contradicts the students' right to celebrate their college's victory.\\\", 'The ordinance deprives persons of their freedom of expression, in violation of the First andFourteenth Amendments.', \\\"The ordinance is biased against persons who can't sing or chant religious songs.\\\", 'The ordinance is invalid as it fails to consider the cultural importance of chanting and singing in a group.', 'The ordinance is not applicable because it was after a football game, a special occasion.', 'The statutory language of the ordinance is vague and overbroad since it attempts to encompass all forms of singing.']\",\"question\":\"A city enacted an ordinance prohibiting the singing and chanting of songs from 1:00P. M. to 1:00A. M. by two or more persons if such noise is audible off the premises where the singing takes place. The ordinance expressly exempted from its purview the singing or chanting of religious songs. After the ordinance was enacted and went into effect, several college students were walking down the street on their way to a victory celebration following a big college football game. They began loudly chanting, \\\"We're number 1. . . we're number 1. \\\" One of the residents who lived on the street was greatly disturbed by the noise and reported the incident to the police, who were immediately summoned to the scene. The students who engaged in the chanting were arrested and charged with violating the ordinance. The students who were prosecuted now bring suit challenging the constitutionality of the city ordinance. Which of the following would constitute their WEAKEST argument against enforcement of the city ordinance?\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}