{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"806a2c7e-1d59-59da-89f1-2e5831ed1e72","task_key":"all--test--806a2c7e-1d59-59da-89f1-2e5831ed1e72","task_revision_id":"1","upstream_id":"","short_description":"Given current patterns of industrial development, what are the future prospects…","config":"all","split":"test","body":"{\"choices\":\"['Whilst energy consumption is correlated to levels of industrialisation, developed states of the North continue to increase their demands for energy. This is balanced by a lesser demand from states in the South; due to their lack of industrialisation their demands on energy are forecast to remain low.', 'Energy demand in the industrialised states has peaked in recent years and data indicates that consumption levels in the North have become constant and are not likely to increase.', 'Whilst forecasts predict that energy consumption in the industrialised states of the North will continue to increase, the major increase in demand will come from the developing states of the South, posing major challenges to global energy security.', 'Although demand from developing states is set to increase the global consumption of dwindling energy resources, technological advancements in alternative energy sources, coupled with comprehensive understanding of current resource levels and access, will secure energy supply in the foreseeable future.']\",\"question\":\"Given current patterns of industrial development, what are the future prospects for energy security?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}