{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fc7c193d-ce7b-5ec6-894e-7ceb0742811a","task_key":"all--test--fc7c193d-ce7b-5ec6-894e-7ceb0742811a","task_revision_id":"1","upstream_id":"","short_description":"Which of the following best describes the existing legacy of structural…","config":"all","split":"test","body":"{\"choices\":\"['Structural adjustment policies have been largely successful in achieving their aims of macroeconomic security in the developing world.', 'The neoliberal principles on which structural adjustment policies have been based have proven well suited to promoting human welfare in developing countries.', 'Neoliberal based adjustment policies have caused great and unnecessary hardship in developing countries and there is still no evidence they achieved their objectives for macroeconomic stability and growth.', 'There is significant evidence that structural adjustment policies have promoted economic growth and macroeconomic stability in the countries in which they were applied.']\",\"question\":\"Which of the following best describes the existing legacy of structural adjustment policies?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}