{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"80d342d7-4943-5898-bdcf-72cd858cb346","task_key":"default--test--5921","task_revision_id":"1","upstream_id":"5921","short_description":"Which of the following procedures should a user auditor include in the audit…","config":"default","split":"test","body":"{\"category\":\"other\",\"options\":\"[\\\"Rely solely on the service auditor's report without any additional review or testing.\\\", \\\"Review the service organization's controls and audit the client's internal controls.\\\", \\\"Ignore the service organization's processes as they are not directly related to the client.\\\", \\\"Audit the client's internal controls without considering the service auditor's report.\\\", \\\"Directly audit the service organization's operations without reviewing the service auditor's report.\\\", 'Review that service auditor’s report on controls placed in operations.', \\\"Review the service organization's controls, without considering the service auditor's report.\\\", 'Audit the service organization’s controls to test the work of the service auditor.', 'Review the service auditor’s report and outline the accounting system in a memo to the working papers', 'Audit the service organization’s controls, assess risk, and prepare the audit plan.']\",\"question\":\"Which of the following procedures should a user auditor include in the audit plan to create that most efficient audit when an audit client uses a service organization for several processes?\",\"src\":\"ori_mmlu-professional_accounting\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}