{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b98ecd13-ae92-5c0b-8e18-1c39be6a7099","task_key":"default--test--5116","task_revision_id":"1","upstream_id":"5116","short_description":"According to COSO, an effective approach to monitoring internal control involves…","config":"default","split":"test","body":"{\"category\":\"other\",\"options\":\"['Increasing the reliability of financial reporting and compliance with applicable laws and regulations.', 'Regularly updating the monitoring procedures as per the changes in business.', 'Conducting surprise audits on a regular basis.', 'Implementing a system for whistle-blowing.', 'Designing and executing monitoring procedures that are prioritized based on risks to achieve organizational objectives.', 'Establishing a foundation for monitoring.', 'Ensuring that the monitoring procedures are understood by all employees.', 'Assessing and reporting the results, including following up on corrective action where necessary.', 'Automating monitoring procedures to the maximum extent possible.']\",\"question\":\"According to COSO, an effective approach to monitoring internal control involves each of the following steps, except\",\"src\":\"ori_mmlu-professional_accounting\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}