{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b70c9a36-e43c-510a-b01a-6a86020ed3bc","task_key":"all--test--b70c9a36-e43c-510a-b01a-6a86020ed3bc","task_revision_id":"1","upstream_id":"","short_description":"Why, in the contemporary studies of security, is the subject of energy security…","config":"all","split":"test","body":"{\"choices\":\"['There exists an array of contemporary challenges to energy security, ranging from resource scarcity concerns to dangers of political instability.', 'The existence of reliable supplies of energy determines the ability of a nation to achieve economic development.', 'Energy security encompasses a broad range of issues that are both contemporary and fundamental to security, ranging from the local and individual to the global scale.', 'All of these options.']\",\"question\":\"Why, in the contemporary studies of security, is the subject of energy security so important?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}