{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"450086ed-5b11-5229-a262-f5b549e4c88c","task_key":"all--test--450086ed-5b11-5229-a262-f5b549e4c88c","task_revision_id":"1","upstream_id":"","short_description":"Before accepting an audit engagement a CPA should evaluate whether conditions…","config":"all","split":"test","body":"{\"choices\":\"[\\\"There are significant differences between the entity's forecasted financial statements and the financial statements to be audited.\\\", 'The CPA will not be permitted to have access to sensitive information regarding the salaries of senior management.', 'There have been substantial inventory write-offs just before the year end in each of the past four years.', 'The CPA becomes aware of the existence of related party transactions while reading the draft financial statements.']\",\"question\":\"Before accepting an audit engagement a CPA should evaluate whether conditions exist that raise questions as to the integrity of management. Which of the following conditions most likely would raise such questions?\",\"subject\":\"professional_accounting\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}