{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"175f95df-3b53-54c6-9d09-beb3f2449ee1","task_key":"all--test--175f95df-3b53-54c6-9d09-beb3f2449ee1","task_revision_id":"1","upstream_id":"","short_description":"What was the importance of peace research during the 1980s?","config":"all","split":"test","body":"{\"choices\":\"['Peace research was inter-disciplinary and politically orientated with immediate policy responsibility accountable to the major powers of the political system.', 'Peace research, in contrast to university IR, was under a great deal of pressure to deal with relevant issues with a high expectation of immediate delivery of policy answers.', 'There was a distance from policy responsibility but European security studies gained political relevance due to the politicization of security issues during the period defined by the peace movement.', 'The setting was simultaneously informed by political theory as the dominant discipline and isolated from developments in theory in the different disciplines.']\",\"question\":\"What was the importance of peace research during the 1980s?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}