{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b58574a3-3534-5a72-9537-a45f68828c06","task_key":"all--test--b58574a3-3534-5a72-9537-a45f68828c06","task_revision_id":"1","upstream_id":"","short_description":"An illegal alien and her three children live in a U. S. city. The city council…","config":"all","split":"test","body":"{\"choices\":\"['valid, because the city can demonstrate that the school fee is necessary to further a compelling governmental interest.', 'valid, because the imposition of the school fee is substantially related to a legitimate governmental interest.', 'invalid, because denying educational services to children of undocumented aliens is not substantially related to an important governmental interest.', 'invalid, because the cost of educating the children imposed an undue burden on the public school system by requiring the school board to hire additional bilingual teachers.']\",\"question\":\"An illegal alien and her three children live in a U. S. city. The city council has enacted an ordinance requiring illegal aliens to pay a $100 \\\"school fee\\\" for each child enrolled in a city public school. Citizens and legal aliens are not required to pay the school fee. The city council has enacted this law to raise funds to hire additional teachers who are bilingual. The city determined that over 15% of children attending public schools in the city were illegal aliens. Furthermore, the city conducted a study and found that the overwhelming majority of illegal aliens residing in the city did not pay any local property taxes. As a result, since the city provided educational benefits to the children of illegal aliens, the school fee furthered a significant governmental interest. The illegal alien, who is indigent, is unable to pay the city school fee. The city will not allow her children to attend school unless the fee is paid. If she seeks your legal advice regarding the constitutionality of the fee, you should advise her that the ordinance is\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}