{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cfd7b360-ed50-56fc-b7dc-a968923e398a","task_key":"all--test--cfd7b360-ed50-56fc-b7dc-a968923e398a","task_revision_id":"1","upstream_id":"","short_description":"This question refers to the following information.","config":"all","split":"test","body":"{\"choices\":\"['Huguenots', 'Lutherans', 'Presbyterians', 'Anabaptists']\",\"question\":\"This question refers to the following information.\\nThe passage below is written by John Calvin.\\nIf we need to be recalled to the origin of election, to prove that we obtain salvation from no other source than the mere goodness of God, they who desire to extinguish this principle, do all they can to obscure what ought to be magnificently and loudly celebrated, and to pluck up humility by the roots. In ascribing the salvation of the remnant of the people to the election of grace, Paul clearly testifies, that it is then only known that God saves whom upon which there can be no claim. They who shut the gates to prevent anyone from presuming to approach and taste this doctrine, do no less injury to man than to God; for nothing else will be sufficient to produce in us suitable humility, or to impress us with a due sense of our great obligations to God. Nor is there any other basis for solid confidence, even according to the authority of Christ, who, to deliver us from all fear, and render us invincible amidst so many dangers, snares, and deadly conflicts, promises to preserve in safety all whom the Father has committed to His care.\\n—John Calvin, Institutes of the Christian Religion, 1559\\nWhich of the following religions that started around the same time as Calvinism was destroyed for supporting adult baptism and pacifism?\",\"subject\":\"high_school_european_history\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}