{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fffdb819-5160-582d-ab77-f3fbe4943f38","task_key":"all--test--fffdb819-5160-582d-ab77-f3fbe4943f38","task_revision_id":"1","upstream_id":"","short_description":"Which of the following is an impact of common structural adjustment policies on…","config":"all","split":"test","body":"{\"choices\":\"['Cost of imports soar, including vital resources such as imported medicines. Basic food prices rise, putting even greater pressure on already stretched household budgets.', 'Reduced health, education, and social welfare spending and the introduction of cost-recovery and user-fees put healthcare and education beyond the reach of many ordinary people. Public sector redundancies and salary freezes lead to fewer teachers and doctors.', 'Massive redundancies and increased unemployment with no social security provision push families deeper into poverty. Farmers and small companies can no longer afford to borrow money and are forced to reduce production or go out of business.', 'All of these options.']\",\"question\":\"Which of the following is an impact of common structural adjustment policies on the poor?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}