{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bcc2b3a0-3cfb-5d20-8ad4-5bdb4d6e4e0c","task_key":"all--test--bcc2b3a0-3cfb-5d20-8ad4-5bdb4d6e4e0c","task_revision_id":"1","upstream_id":"","short_description":"How will climate change affect future food security?","config":"all","split":"test","body":"{\"choices\":\"['It will have negative impacts in most developing countries because of the increased frequency of droughts, storms and floods.', 'The impact will be positive, because drier weather will mean less habitat for malaria mosquitoes, so fewer workers will be sick at harvest time.', 'The impact will be positive because there will be more carbon dioxide available for plant photosynthesis.', 'There currently is no scientific consensus as to whether climate change is occurring or whether it will over the next 50 years.']\",\"question\":\"How will climate change affect future food security?\\n\",\"subject\":\"nutrition\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}