{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0884d617-55dd-52b4-a128-42093c009411","task_key":"all--test--0884d617-55dd-52b4-a128-42093c009411","task_revision_id":"1","upstream_id":"","short_description":"Which of these statements is not applicable to the development of peace studies…","config":"all","split":"test","body":"{\"choices\":\"['Within peace studies, one of the later developments was a major interest in conflict prevention, conflict resolution, and peacekeeping.', \\\"At the height of the Cold War, peace studies was frequently labelled 'appeasement studies' and was bitterly opposed by critics.\\\", 'By the 1970s, prominent peace researchers were calling for a broadening in the remit of the field but were largely unsuccessful in their attempts.', 'Peace studies sought to provide a more global and non-state centric view of major issues of conflict.']\",\"question\":\"Which of these statements is not applicable to the development of peace studies in the twentieth century?\",\"subject\":\"security_studies\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}