{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"61186d18-dd59-5ce2-9323-35669b2c9904","task_key":"all--test--61186d18-dd59-5ce2-9323-35669b2c9904","task_revision_id":"1","upstream_id":"","short_description":"Which of the following best describes the Supreme Court's doctrine of…","config":"all","split":"test","body":"{\"choices\":\"['Although the Constitution empowers the federal government to regulate international trade, states may establish boycotts of goods imported from countries that use child labor.', 'While the Congress creates laws, and the executive branch enacts and enforces those laws, only the Supreme Court may decide which laws and executive actions are unconstitutional.', 'The Fifth Amendment guarantees that an individual may not be deprived of life, liberty, or property without due process, and this protection provides a legal justification for those who do not wish to serve on a jury.', 'The Bill of Rights articulates certain rights in order to protect individuals from the federal government, and the Fourteenth Amendment extends most of those rights to protect individuals from the state governments as well.']\",\"question\":\"Which of the following best describes the Supreme Court's doctrine of incorporation?\",\"subject\":\"high_school_government_and_politics\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}