{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"da887c6d-abf4-56ed-979d-b81f5c884d19","task_key":"default--test--5849","task_revision_id":"1","upstream_id":"5849","short_description":"Which of the following procedures would an auditor most likely perform to obtain…","config":"default","split":"test","body":"{\"category\":\"other\",\"options\":\"['Check compliance with laws and regulations during the subsequent event period.', \\\"Assess the financial stability of the company's key customers and suppliers.\\\", 'Trace information from shipping documents to sales invoices and sales journal transactions.', 'Evaluate the adequacy of the allowance for doubtful accounts.', \\\"Conduct a physical count of the company's inventory.\\\", 'Verify inventory pledged under loan agreements by confirming the details with financial institutions.', 'Compare the financial statements being reported on with those of the prior year.', 'Inquire about the current status of transactions that were recorded on the basis of preliminary data.']\",\"question\":\"Which of the following procedures would an auditor most likely perform to obtain evidence about the occurrence of subsequent events?\",\"src\":\"ori_mmlu-professional_accounting\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}