{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e512fe53-ab57-5f4b-bc6c-32000da31279","task_key":"all--test--e512fe53-ab57-5f4b-bc6c-32000da31279","task_revision_id":"1","upstream_id":"","short_description":"How might the period of academic institutionalization be assessed?","config":"all","split":"test","body":"{\"choices\":\"['The distinct phenomenon of strategic studies emerged as an imported American specialty. It emerged in the US and was exported to Europe. European security studies was \\\"theory has already been done\\\" kind of work.', \\\"The think tanks became routine producers of narrow technical problem-solving succumbing to 'hectic empiricism': the internal logic of its key contribution (deterrence) broke down.\\\", 'Peace research developed on a parallel but separate track, and particularly the distinct critical branch was seen neither by its representatives nor by security studies as part of the latter.', 'All of these options.']\",\"question\":\"How might the period of academic institutionalization be assessed?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}