{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9f15585b-babe-5880-b747-de2a1ec22c19","task_key":"all--test--9f15585b-babe-5880-b747-de2a1ec22c19","task_revision_id":"1","upstream_id":"","short_description":"What are the implications of recent technological change and development,…","config":"all","split":"test","body":"{\"choices\":\"[\\\"Technological developments do not affect the majority of the world's population and so the advancement of telecommunications and digital media are not of concern to peace studies.\\\", 'Digital information, media, and communications technology is likely to inspire greater harmony in the international system as the global population learns more about the world in which they live, and the lives of others around them.', 'With access to digital information, such as media and the internet, disempowered populations will become aware of their own exclusion and the inequalities of the global system. This could lead to widespread frustration and revolution.', 'Technological change and development is likely to strengthen the power of already dominant international players, and to reinforce the status quo of international relations.']\",\"question\":\"What are the implications of recent technological change and development, according to peace studies?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}