{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"61380975-d979-51c7-97d7-53b7f353accf","task_key":"default--test--1632","task_revision_id":"1","upstream_id":"1632","short_description":"A city has granted a license to a private utility company to provide electrical…","config":"default","split":"test","body":"{\"category\":\"law\",\"options\":\"['The establishment clause.', 'The supremacy clause.', 'The free exercise clause.', 'The full faith and credit clause.', 'The ex post facto clause.', 'The commerce clause.', 'The privileges and immunities clause of ArticleIv.', 'The equal protection clause.', 'The takings clause.', 'The due process clause.']\",\"question\":\"A city has granted a license to a private utility company to provide electrical service to the residents in the city. After approving the license to the utility company, the city council then passed a measure by which the utility company was required to insert in its monthly billing statements a letter from a private consumer group criticizing the high cost of electrical service. The cost of printing and mailing the monthly letter was paid entirely by the consumer group. Nonetheless, the utility company vehemently objected to having such a critical letter enclosed in their monthly billing statements. However, the city council warned the utility company that unless it complied with the directive, the city would revoke its license for electrical service. The utility company filed suit in federal court seeking a hearing prior to its license being revoked by the city council. Which of the following constitutional provisions would provide the utility company with the strongest grounds with which to challenge the city council measure?\",\"src\":\"ori_mmlu-professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}