{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3ece38dd-c7a8-51e4-90ce-5096967f4bcd","task_key":"all--test--3ece38dd-c7a8-51e4-90ce-5096967f4bcd","task_revision_id":"1","upstream_id":"","short_description":"Easily produced genetic variation is key to the rapid evolution of viral and…","config":"all","split":"test","body":"{\"choices\":\"['HIV, which can remain integrated into the host genome for many years', 'The flu virus, which changes its envelope proteins', 'MRSA, which has become resistant to many antibiotics', 'Multiple sclerosis, which attacks the cells of the nervous system']\",\"question\":\"Easily produced genetic variation is key to the rapid evolution of viral and microbial populations. Furthermore, pathogens that need to escape the immune system rely on this variation to generate new surface antigens that go unrecognized by the host’s immune system. Which of the following is an example of this antigenic variation?\",\"subject\":\"high_school_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}