{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7ce87144-e4a5-5a89-8c32-1f3f0b2152ac","task_key":"all--test--7ce87144-e4a5-5a89-8c32-1f3f0b2152ac","task_revision_id":"1","upstream_id":"","short_description":"How can we define energy security?","config":"all","split":"test","body":"{\"choices\":\"['To achieve energy security is to ensure that there are currently sufficient energy resources to sustain the current consumption and demand for energy across the globe.', 'Energy security refers to the ability of the current energy supplies to meet the demands of state military consumption, placing the military at the core of the security paradigm.', 'To achieve energy security is to secure the supply of energy that is needed in the current context and in the future, with regards to foreseeable changes in demand where relevant.', 'Energy security refers to the ability of individuals, economic and non-state actors to access the energy required for sustaining their growth and development.']\",\"question\":\"How can we define energy security?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}