{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cb1a823f-bef0-5ff1-8d05-6f30cafbd3ad","task_key":"all--test--cb1a823f-bef0-5ff1-8d05-6f30cafbd3ad","task_revision_id":"1","upstream_id":"","short_description":"That modern Africans do not possess any Neandertal DNA indicates that:","config":"all","split":"test","body":"{\"choices\":\"['Gene flow between Neandertals and anatomically modern humans must have occurred before Neandertals migrated out of Africa.', 'Gene flow between Neandertals and anatomically modern humans occurred after anatomically modern humans migrated out of Africa.', 'Neandertals who lived in Africa did not interbreed with anatomically modern humans, but must have followed them when they migrated out of Africa.', 'Interbreeding between anatomically modern humans and Neandertals never occurred.']\",\"question\":\"That modern Africans do not possess any Neandertal DNA indicates that:\",\"subject\":\"prehistory\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}