{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"250a3093-434f-56fc-93a5-8a47062fc977","task_key":"all--test--250a3093-434f-56fc-93a5-8a47062fc977","task_revision_id":"1","upstream_id":"","short_description":"Which of the following is most correct concerning cell differentiation in…","config":"all","split":"test","body":"{\"choices\":\"['Cells in different tissues contain different sets of genes, leading to structural and functional differences.', 'Differences in the timing and expression levels of different genes leads to structural and functional differences.', 'Differences in the reading frame of mRNA leads to structural and functional differences.', 'Differences between tissues result from spontaneous morphogenesis.']\",\"question\":\"Which of the following is most correct concerning cell differentiation in vertebrates?\",\"subject\":\"high_school_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}