{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9bbe65b8-43c0-5973-8c29-b56ae9df1842","task_key":"all--test--9bbe65b8-43c0-5973-8c29-b56ae9df1842","task_revision_id":"1","upstream_id":"","short_description":"Which of the following matters is included in a typical comfort letter?","config":"all","split":"test","body":"{\"choices\":\"['Negative assurance on whether unaudited condensed financial information complies in form with the accounting requirements of the SEC.', 'An opinion on whether any fraud risk factors indicate significant incentive and opportunity relating to fraudulent financial reporting.', 'Positive assurance on whether there has been any change in capital stock or long-term debt since the date of the audited financial statements.', \\\"An opinion on whether the entity's internal control components are operating as designed in achieving their stated objectives.\\\"]\",\"question\":\"Which of the following matters is included in a typical comfort letter?\",\"subject\":\"professional_accounting\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}