{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"82f5018a-1614-5cca-ac78-9545a8142403","task_key":"all--test--82f5018a-1614-5cca-ac78-9545a8142403","task_revision_id":"1","upstream_id":"","short_description":"Which of these statements is commonly regarded as a tangible benefit of the…","config":"all","split":"test","body":"{\"choices\":\"['Securitizing injects urgency into an issue and leads to a sustained mobilization of political support and deployment of resources.', 'Securitization encourages more efficient handling of complex problems.', 'Securitization mobilizes popular support for policies in specific areas by calling them security relevant and encourages the allocation of more resources.', 'All of these options.']\",\"question\":\"Which of these statements is commonly regarded as a tangible benefit of the securitization process?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}