{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"875bf149-40a6-5221-b14f-e04aba8ba4c2","task_key":"default--test--5708","task_revision_id":"1","upstream_id":"5708","short_description":"Inherent risk and control risk differ from detection risk in which of the…","config":"default","split":"test","body":"{\"category\":\"other\",\"options\":\"['Inherent risk and control risk can be completely eliminated.', 'Inherent risk and control risk exist as a result of the auditor’s judgment about materiality.', \\\"Detection risk is a result of the auditor's judgment while inherent risk and control risk are not.\\\", \\\"Inherent risk and control risk are the result of the client's internal control system.\\\", 'Inherent risk and control risk exist independently of the audit.', 'Inherent risk and control risk are eliminated through the audit process.', 'Inherent risk and control risk are controlled by the auditor.', 'Inherent risk and control risk are solely determined by the audit.', 'Detection risk is controlled by the client while inherent risk and control risk are not.', 'Inherent risk and control risk are calculated by the client.']\",\"question\":\"Inherent risk and control risk differ from detection risk in which of the following ways?\",\"src\":\"ori_mmlu-professional_accounting\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}