{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3da53af0-6af5-542d-8d39-a5c77edf0541","task_key":"default--test--5408","task_revision_id":"1","upstream_id":"5408","short_description":"The fixed assets and related depreciation of a company are currently tracked on…","config":"default","split":"test","body":"{\"category\":\"other\",\"options\":\"['Purchasing a stand-alone fixed asset program for managing the assets and related depreciation', 'Adopting the fixed asset module of the new system for integration.', 'Leaving the decision to the individual departments to choose their preferred method', 'Adopting a cloud-based fixed asset management system', 'Incorporating blockchain technology for asset tracking and depreciation', 'Implementing an open-source fixed asset system to manage the assets and related depreciation', 'Continuing to use the current spreadsheet process because there have been no issues in this area.', 'Implementing an AI-based fixed asset system to manage the assets and related depreciation', 'Developing a new fixed asset system to manage the assets and related depreciation', 'Outsourcing the management of fixed assets to a third-party company']\",\"question\":\"The fixed assets and related depreciation of a company are currently tracked on a password-protected spreadsheet. The information technology governance committee is designing a new enterprise-wide system and needs to determine whether the current fixed asset process should be included because the current system seems to be working properly. What long-term solution should the committee recommend?\",\"src\":\"ori_mmlu-professional_accounting\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}