{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b7f80600-81ef-52ac-a20e-1d27a2116b65","task_key":"all--test--b7f80600-81ef-52ac-a20e-1d27a2116b65","task_revision_id":"1","upstream_id":"","short_description":"In what ways can the different relationship between US and European security…","config":"all","split":"test","body":"{\"choices\":\"[\\\"The different relationship to the concept of security: in Europe the debate has stayed as part of politico-self-reflection of the scholar who 'does security;' whereas in the US, the question of the concept of security is seen at the most a necessary 'define your' terms' operation.\\\", 'The different relationship to the exact form of knowledge that is valued. The US is more rationalist, Europe the more reflectivist. In the US security studies debate hypothesis is typically examined as cause-effect relationships, tied into general debates and with measurement of ideational variables.', \\\"In the US major competing explanations emphasized, on the one hand, the US's liberal hegemony, and, on the other hand, the purely power based stability of presumed unipolarity in which balancing becomes impossible.\\\", 'All of these options.']\",\"question\":\"In what ways can the different relationship between US and European security studies be explained?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}