{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"57b3607e-5f89-5d95-bd27-06a51571457b","task_key":"all--test--57b3607e-5f89-5d95-bd27-06a51571457b","task_revision_id":"1","upstream_id":"","short_description":"What difference will urbanisation make for hunger and malnutrition?","config":"all","split":"test","body":"{\"choices\":\"['No significant difference; low-income urban and rural people face similar constraints in accessing food and consume similar diets in developing countries.', 'It will reduce poverty and hunger because these are almost entirely concentrated in rural areas.', 'Urban dwellers depend more than rural people on purchases to acquire food, have little opportunity to grow their own food, and so are much more vulnerable to food price increases.', 'Poor city folk eat mainly sorghum, millet, maize and root crops, so a lot more of those foods will need to be produced as the world urbanises.']\",\"question\":\"What difference will urbanisation make for hunger and malnutrition?\\n\",\"subject\":\"nutrition\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}