{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"646cd151-bfba-5d25-95fd-472b66bf8168","task_key":"all--test--646cd151-bfba-5d25-95fd-472b66bf8168","task_revision_id":"1","upstream_id":"","short_description":"The geneticist Mary Lyon hypothesized the existence of structures visible just…","config":"all","split":"test","body":"{\"choices\":\"['In the early female embryo, one copy of the X chromosome becomes inactivated in every body cell.', 'The same chromosome in every cell of a normal female is inactivated.', 'A male with the XXY genotype will have one Barr body.', 'Barr bodies consist of highly methylated DNA.']\",\"question\":\"The geneticist Mary Lyon hypothesized the existence of structures visible just under the nuclear membrane in mammals, which were later named Barr bodies. Which of the following statement is NOT correct about Barr bodies?\",\"subject\":\"high_school_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}