{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1ba781be-682c-5534-98f0-7f79d8ce4028","task_key":"all--test--1ba781be-682c-5534-98f0-7f79d8ce4028","task_revision_id":"1","upstream_id":"","short_description":"During a hotly contested gubernatorial election, a local newspaper endorsed the…","config":"all","split":"test","body":"{\"choices\":\"['equal protection clause of the Fourteenth Amendment.', 'bill of attainder provision under Article I, Section 10.', 'privileges or immunities clause of the Fourteenth Amendment.', 'First Amendment, as incorporated in the Fourteenth Amendment.']\",\"question\":\"During a hotly contested gubernatorial election, a local newspaper endorsed the candidacy of a corporate official of a chemical company. Inspired by a progressive revolt against the chemical company's domination of the state government, the corporate official's opponent, won by an extremely close margin. After the new governor took office, he vowed to get back at the company that owned the local newspaper for its newspaper's endorsement of the corporate official. Using his influence, the new governor was instrumental in getting the state legislature to pass a bill that imposed a special tax on the sale of ink and paper used in the publication of newspapers and periodicals of general circulation. The tax bill was signed into law by the governor. The strongest constitutional basis upon which to challenge the validity of the tax would be the\",\"subject\":\"professional_law\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}