{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1d4841c5-d8ed-5e1d-9522-b68557e7debb","task_key":"default--test--5922","task_revision_id":"1","upstream_id":"5922","short_description":"When assessing an internal auditor's objectivity an independent auditor should","config":"default","split":"test","body":"{\"category\":\"other\",\"options\":\"['Perform tests of controls to determine whether significant internal control activities are properly maintained.', \\\"Review the internal auditor's educational background and certifications.\\\", \\\"Evaluate the internal auditor's personal financial statements.\\\", \\\"Consider the internal auditor's relationship with external regulatory bodies.\\\", \\\"Review the internal auditor's reports to verify that the conclusions reached are consistent with the procedures performed.\\\", 'Analyze the risk factors that relate to misstatements arising from the misappropriation of assets.', 'Assess the frequency and severity of past audit findings.', 'Consider the policies that prohibit the internal auditor from auditing areas where relatives are employed in key management positions.']\",\"question\":\"When assessing an internal auditor's objectivity an independent auditor should\",\"src\":\"ori_mmlu-professional_accounting\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}