{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f2d44b71-0f50-5f70-858b-c9e85a423f5d","task_key":"all--test--f2d44b71-0f50-5f70-858b-c9e85a423f5d","task_revision_id":"1","upstream_id":"","short_description":"After reviewing the end-user computing (EUC) policy of an organization, an…","config":"all","split":"test","body":"{\"choices\":\"['Management places the same degree of reliance on the files as they do on files generated from mainframe systems.', 'Management receives limited information for decision making due to a lack of flexibility in EUC files.', 'Management is unable to respond to competitive pressures quickly.', 'Management continues to incur additional cost because it takes more hours to do the tasks using EUC.']\",\"question\":\"After reviewing the end-user computing (EUC) policy of an organization, an internal auditor audits the actuarial function and notices that some minimum control requirements are missing. Which of the following is a risk of using potentially incorrect enduser developed files?\",\"subject\":\"professional_accounting\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}