{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"149f194f-908e-5e0b-a0af-b8f967b269a6","task_key":"all--test--149f194f-908e-5e0b-a0af-b8f967b269a6","task_revision_id":"1","upstream_id":"","short_description":"In an e-commerce environment that requires that the information technology (IT)…","config":"all","split":"test","body":"{\"choices\":\"['Maintain appropriate written source documents so the data can be re-entered if it is lost or compromised', 'Maintain redundant systems for instant availability to assure the flow of transactions', 'Review additional expenses to obtain the required amount of business interruption insurance coverage for the organization', 'Assure that appropriate data backups are stored in an off-site location']\",\"question\":\"In an e-commerce environment that requires that the information technology (IT) system be available on a continuous basis, more emphasis will be placed on which of the following aspects of the planning than in a traditional organization?\",\"subject\":\"professional_accounting\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}