{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"65295202-2a76-5804-8f6d-6383e3a765a2","task_key":"all--test--65295202-2a76-5804-8f6d-6383e3a765a2","task_revision_id":"1","upstream_id":"","short_description":"In what ways did the Human Development Report, published by the United Nations…","config":"all","split":"test","body":"{\"choices\":\"['The report outlined seven areas or components of human security that policymakers should henceforth devote greater political attention and capital to: economic security, food security, health security, environmental security, personal security, community security, and political security.', 'The report highlighted the considerable burden that infectious diseases continue to pose in the developing world-including HIV/AIDS, tuberculosis, and malaria.', 'The report advocates a framework of human security analysis that aims to redress the perceived imbalance in security thinking that has been predominant in traditional security studies.', 'All of these options.']\",\"question\":\"In what ways did the Human Development Report, published by the United Nations Development Program in 1994, challenge the traditional security paradigm?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}