{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"09845d98-ae89-5ad3-986d-aba9c924af2a","task_key":"all--test--09845d98-ae89-5ad3-986d-aba9c924af2a","task_revision_id":"1","upstream_id":"","short_description":"All of the following support the endosymbiotic theory that ancestors of…","config":"all","split":"test","body":"{\"choices\":\"['Mitochondria and chloroplasts divide independently of the eukaryotic host cell by a process similar to binary fission.', 'Mitochondria and chloroplasts have ribosomes that more closely resemble those of bacteria than of eukaryotic cells.', 'Mitochondria and chloroplasts function independently from the eukaryotic host cell.', 'Mitochondria, chloroplasts, and bacteria have a single, circular chromosome without histones or proteins.']\",\"question\":\"All of the following support the endosymbiotic theory that ancestors of mitochondria and chloroplasts were once independent, free-living prokaryotes EXCEPT:\",\"subject\":\"high_school_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}