{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"85520f78-92e9-54b9-a4f0-f64295c89cdd","task_key":"all--test--85520f78-92e9-54b9-a4f0-f64295c89cdd","task_revision_id":"1","upstream_id":"","short_description":"When the first tiny prokaryotic cell took up residence inside a larger…","config":"all","split":"test","body":"{\"choices\":\"['DNA can reproduce more efficiently.', 'Even though prokaryotes do not have mitochondria, they contain structures that carry out the same function.', 'Organelles separate specific reactions in the cell and increase metabolic efficiency.', 'Compartmentalization enables prokaryotes to reproduce more quickly.']\",\"question\":\"When the first tiny prokaryotic cell took up residence inside a larger prokaryotic cell, it heralded the advent of the eukaryotic cell and led to an explosion of new life on Earth. Since then, most cells on Earth have internal organelles. Which of the following best summarizes an advantage of having internal membranes and organelles?\",\"subject\":\"high_school_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}