{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5f6d38f5-b52d-5f54-93ed-beb37c33dbde","task_key":"all--test--5f6d38f5-b52d-5f54-93ed-beb37c33dbde","task_revision_id":"1","upstream_id":"","short_description":"Mouse sperm contain receptor proteins that bind to a glycoprotein (ZP3) in the…","config":"all","split":"test","body":"{\"choices\":\"['Injecting eggs with antibodies that bind to ZP3 blocks in vitro fertilization.', 'Incubating sperm with purified ZP3 prior to mixing sperm and eggs blocks in vitro fertilization.', 'Incubating eggs with antibodies that bind to ZP3 blocks in vitro fertilization.', 'Coating synthetic beads with a different glycoprotein, ZP2, fails to lead to sperm aggregation on the beads.']\",\"question\":\"Mouse sperm contain receptor proteins that bind to a glycoprotein (ZP3) in the zona pellucida of mouse eggs. Binding of ZP3 receptors to ZP3 initiates the sperm’s acrosomal reaction. All of the following experimental observations would be expected EXCEPT:\",\"subject\":\"college_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}