{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fade1a71-e88b-59b4-9e26-b03ff87fe192","task_key":"all--test--fade1a71-e88b-59b4-9e26-b03ff87fe192","task_revision_id":"1","upstream_id":"","short_description":"Which of the following would a successor auditor ask the predecessor auditor to…","config":"all","split":"test","body":"{\"choices\":\"['Disagreements between the predecessor auditor and management as to significant accounting policies and principles.', 'The predecessor auditor’s understanding of the reasons for the change of auditors', 'Facts known to the predecessor auditor that might bear on the integrity of management.', 'Matters that may facilitate the evaluation of financial reporting consistency between the current and prior years.']\",\"question\":\"Which of the following would a successor auditor ask the predecessor auditor to provide after accepting an audit engagement?\",\"subject\":\"professional_accounting\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}