{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3070d1cb-1096-5cda-860b-125fc8fef1dd","task_key":"all--test--3070d1cb-1096-5cda-860b-125fc8fef1dd","task_revision_id":"1","upstream_id":"","short_description":"Which of the following conditions does not constitute 'human security'?","config":"all","split":"test","body":"{\"choices\":\"['A condition where people are given relief from the traumas that afflict human development, are safe from threats and are protected from hurtful disruptions to their daily lives.', 'A condition in which every citizen is free from the threat of physical violence, regardless of their race, ethnicity or other identity.', 'A condition where people are guaranteed the ability to live and develop, free from political oppression or prejudice, safe from threats posed by their own or external state actors.', 'A condition where people exist independently of state support, where human life is self-sufficient in that individuals do not require the assistance of state apparatus in order to live securely.']\",\"question\":\"Which of the following conditions does not constitute 'human security'?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}