{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e56bd733-cfc7-55e6-9b46-501b787763c9","task_key":"all--test--e56bd733-cfc7-55e6-9b46-501b787763c9","task_revision_id":"1","upstream_id":"","short_description":"Prior to commencing the compilation of financial statements of a nonissuer, an…","config":"all","split":"test","body":"{\"choices\":\"['Verify that the financial information supplied by the entity agrees with the books of original entry.', 'Perform preliminary analytical procedures to identify accounts that may represent specific risks relevant to the engagement.', \\\"Make inquiries of management concerning the entity's procedures used in adjusting and closing the books of account.\\\", \\\"Obtain an understanding of any specialized financial reporting frameworks and practices used in the entity's industry.\\\"]\",\"question\":\"Prior to commencing the compilation of financial statements of a nonissuer, an accountant is required to\",\"subject\":\"professional_accounting\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}