{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b09aff57-437f-58eb-9e29-7c976f63021c","task_key":"all--test--b09aff57-437f-58eb-9e29-7c976f63021c","task_revision_id":"1","upstream_id":"","short_description":"In what ways do environmental issues present a concern for peace researchers in…","config":"all","split":"test","body":"{\"choices\":\"['Environmental constraints can limit conventional economic growth, posing a direct threat to economic security and development.', 'Environmental changes, such as rising sea levels, can threaten the land on which populations are settled as well as their access to resources. Migration as a result of these changes presents threats to societal, economic and other sectors of security.', 'Environmental degradation and increased demand for resources is likely to lead to scarcity and result in conflict.', 'All of these options.']\",\"question\":\"In what ways do environmental issues present a concern for peace researchers in the twenty-first century?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}