{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"66a98682-8d39-53b7-abee-99c8a6c9f4e4","task_key":"all--test--66a98682-8d39-53b7-abee-99c8a6c9f4e4","task_revision_id":"1","upstream_id":"","short_description":"The acrosome and cortical reactions that occur immediately after fertilization…","config":"all","split":"test","body":"{\"choices\":\"['The sperm will fertilize the ovum.', 'The zygote will begin to divide normally.', 'One and only one sperm will fertilize the egg.', 'The zygote will not divide into two embryos, producing twins.']\",\"question\":\"The acrosome and cortical reactions that occur immediately after fertilization ensure which of the following?\",\"subject\":\"high_school_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}