{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"mmlu","formal_name":"MMLU","introduction":"MMLU asks four-way multiple-choice questions across 57 subjects, from elementary material to professional-level examinations. Since 2020 it has been the most widely cited single reference point for general capability.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://github.com/hendrycks/test","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"103b4d0f-6e28-515c-9f0f-43a0f229a059","task_key":"all--test--103b4d0f-6e28-515c-9f0f-43a0f229a059","task_revision_id":"1","upstream_id":"","short_description":"Apoptosis, which is programmed cell death, is a necessary process in living…","config":"all","split":"test","body":"{\"choices\":\"['It occurs randomly.', 'A particular cell dies when it is no longer needed by the organism.', 'A cell carries out apoptosis when too many mutations have accumulated.', 'Plant cells carry out apoptosis as a defense measure in cells that have been infected by parasites.']\",\"question\":\"Apoptosis, which is programmed cell death, is a necessary process in living organisms. Which of the following is NOT correct about apoptosis?\",\"subject\":\"high_school_biology\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://github.com/hendrycks/test","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}