{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"59e88c2f-6fb5-5782-97aa-7757c34a66b4","task_key":"all--test--59e88c2f-6fb5-5782-97aa-7757c34a66b4","task_revision_id":"1","upstream_id":"","short_description":"Which of the following procedures would an auditor most likely perform before…","config":"all","split":"test","body":"{\"choices\":\"[\\\"Confirm with client's lawyer that all litigation probable of assertion has been disclosed to the auditor.\\\", \\\"Obtain an understanding of the client's internal control activities.\\\", 'Determine whether there are any liens or encumbrances on assets that have been pledged as collateral.', \\\"Consider the client's plans and ability to meet imminent purchase commitments and cash flow obligations.\\\"]\",\"question\":\"Which of the following procedures would an auditor most likely perform before the balance sheet? date?\",\"subject\":\"professional_accounting\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}