{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4938b1c9-3ad1-59ff-9c02-c4990b1900f8","task_key":"all--test--4938b1c9-3ad1-59ff-9c02-c4990b1900f8","task_revision_id":"1","upstream_id":"","short_description":"Viral transduction is the process by which viruses carry bacterial DNA from one…","config":"all","split":"test","body":"{\"choices\":\"['By making the bacterial cell more resistant to predators', 'By directly creating new species of bacteria', 'By increasing genetic variation of the bacteria', 'By selecting for viruses better able to infect bacteria']\",\"question\":\"Viral transduction is the process by which viruses carry bacterial DNA from one bacterial cell to another. In what way does this process play a role in bacterial evolution?\",\"subject\":\"high_school_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}