{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu-pro","formal_name":"MMLU-Pro","introduction":"MMLU-Pro rebuilds MMLU with ten answer options instead of four and removes items that no longer separate models. Questions span fourteen academic and professional subjects.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bf4ab4ec-93d5-5a64-af5b-76cf4861dc96","task_key":"default--test--5561","task_revision_id":"1","upstream_id":"5561","short_description":"After reviewing the end-user computing (EUC) policy of an organization, an…","config":"default","split":"test","body":"{\"category\":\"other\",\"options\":\"['Inaccurate EUC files lead to flawed strategic planning.', 'Management continues to incur additional cost because it takes more hours to do the tasks using EUC.', 'EUC systems are not compatible with other systems in the organization.', 'Management has to dedicate more resources to maintain EUC systems.', 'Management receives limited information for decision making due to a lack of flexibility in EUC files.', 'EUC files become obsolete quickly, requiring frequent updates.', 'Management experiences difficulty in tracking changes made to files in EUC systems.', 'Management is unable to respond to competitive pressures quickly.', 'Management places the same degree of reliance on the files as they do on files generated from mainframe systems.', 'EUC files lack proper security measures, risking unauthorized access.']\",\"question\":\"After reviewing the end-user computing (EUC) policy of an organization, an internal auditor audits the actuarial function and notices that some minimum control requirements are missing. Which of the following is a risk of using potentially incorrect enduser developed files?\",\"src\":\"ori_mmlu-professional_accounting\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}